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SOME EFFECTS OF PROMOTION AND NON- 
PROMOTION UPON THE SOCIAL AND PER- 
SONAL ADJUSTMENT OF CHILDREN 


JOHN I. GOODLAD 
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Emory, Georgia 


SECTION I 
THE PROBLEM 


Purpose of the Study 





THE PURPOSE of this study is to deter- 
mine whether or not differences in social and 
personal adjustment exist between two groups 
of promoted and nonpromoted children. An at- 
tempt will be made to evaluate the nature of any 
differences found and to explain the relationship 
of these differences to the factors of promotion 
and nonpromotion. This should suggest implica- 
tions for educational policy governing the class- 
ification of pupils. Finally, it is hoped that, as 
a result of the findings, specific recommenda- 
tions may be made for the grade placement and 
subsequent instruction of slow-learning boys and 
girls in the elementary school. 


An Evaluation of Promotion and Nonpromotici 





Promotion practices and achievement. — 
Studies into the achievement of repeaters indicate 
that these children do no better than children of 
like ability who are promoted. This was sug- 
gested by Keyes nearly forty years ago when he 
reported that only 21 percent of a large group of 
repeaters did better after repeating a grade 
than before, 39 percent actually did worse (24). 
Of course, it is impossible to estimate how well 
these same children might have done had they 
been promoted. Arthur sought to answer this 
question when she matched a group of repeaters 
with a group of non-repeaters on the basis of 
mental age and discovered that the former 
learned no more than the latter over a two-year 
period (3). She put forward the thought, how - 
ever, that failure to eliminate the causes of re- 
tention rather than the repeating experience it- 








self may have been the more potent factor in de- 
termining subsequent achievement. The cause- 
and-effect relationship of a given factor can be 
clarified only by holding constant other factors 
likely to be influential. Klene and Branson took 
cognizance of this fact when they equated child- 
ren, all of whom were to be retained inthe grade, 
on the basis of chronological age, mental age, 
and sex (25). Half were then promoted and 
half retained in the present grade. They con- 
cluded that, on the whole, potential repeaters 
profited more from promotion than did the re- 
peaters from nonpromotion so far as achieve- 
ment is concerned, In this connection, Cheyney 
and Boyer observed that lack of readiness for 
the work of a given grade is largely due to a 
slow learning rate, which will not be improved 
by repeating a grade section (9). Saunders 
summed up an extensive survey of studies into 
the effects of nonpromotion upon school achieve- 
ment as follows: 


....it may be concluded that nonpro- 
motion of pupils in elementary schools 
in order to assure mastery of subject 
matter does not often accomplish its ob- 
jective. Children do not appear to learn 
more by repeating a grade but experience 
less growth in subject-matter achieve- 
ment than they do when promoted, There- 
fore a practice of nonpromotion because 
a pupil does not learn sufficient subject 
matter in the course of a school year, or 
for the purpose of learning subject mat- 
ter, is not justifiable (37). 


Promotion practices and homogeneous group- 


ing. For most teachers, to secure a class of 
children closely approximating one another in 
all areas of development would be the realiza- 
tion of a teaching Utopia. However, Keliher (23) 
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questions the social desirability and Elsbree 
doubts the feasibility of obtaining any such con- 
dition of general homogeneity (12). Burr points 
out that when groups are made non-overlapping 
in achievement for one subject, or even for a 
phase of a subject, they overlap greatly in other 
subjects or other phases of the same subject 
(6). From a study of 46 schools with varying 
rates of slow progress, Caswell (7) c oncluded 
that variability in achievement is no less for 
schools with high rates of nonpromotion than 
for schools with lower rates of nonpromotion, 
findings that are substantially inagreement with 
those of Akridge (1). Whether or not homogen- 
eous grouping be desirable or attainable, non- 
promotion does not appear to reduce the range 
of specific abilities with which the teacher has 
to cope. 

Promotion practices and habits and attitudes. 
—Viele, arguing for the abandonment of no-fail- 
ure programs, Claimed that children will not put 
forth their best efforts when they know from the 
Start that they are to be promoted (41). However, 
studies into the relative effects of various incen- 
tives upon school work tend to discredit this line 
of reasoning. Both Hurlock (21) and Gilchrist 
(20) found that groups of students who had been 
praised for their work showed greater improve- 
ment over a period of time than did students 
who had been reproved for the quality of their 
work. Sandin found that the attitude of slow- 
progress pupils toward school was not commend- 
able. He reported that approximately 40 percent 
of these children wished to quit school as soon 
as possible and that a like percentage, as against 
14 percent of regular progress pupils, indicated 
that they disliked school and sc hool work (36). 
Of course, these children might have felt the 
same had they been promoted; Sandin set up no 
control factors suchas matchedgroups. However, 
the above findings support Farley’s conclusions 
that the failing child, receiving less satisfaction 
from his work, tends to become discouragedand 
frequently antagonistic (15). 

Promotion practices and behavior. —~The 
question of the effects of promotion practices up- 
on behavior has provoked considerable contro- 
versy. Robinson, for example, maintains that 
failure replaces interest in school work with 
feelings of resentment that may be expressed in 
aggression (35). Jablow, on the contrary, main- 
tains that the frustration produced from inabil- 
ity to perform the work of the higher grade leads 
Slow-learners to become disciplinary problems 
(22). Research studies conducted by McElwee 
(28) and by Sandin (36) revealed a greater inci- 
dence of behavior considered troublesome to 
teachers among retarded children than among 
regular-progress pupils. Although these find- 
ings favor promotion over nonpromotion, further 
experiments with carefully controlled situations 
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need to be conducted. 

Promotion practices and personal-social ad- 
justment. —The area involving personal-social 
adjustment as affected by promotion practices 
probably is most barren of research. A study 
by Farley, Frey, and Garland indicated a sig- 
nificant correlation between retardation and a 
low score on a five-point character-rating scale 
but left open the question as to whether this was 
a cause or an effect relationship (16). Anfinson 
sought to determine the nature of this relation- 
ship by setting up controls (2). He matched 116 
pairs of junior high school pupils on the basis 
of school attendance, chronological age, sex, 
intelligence, and socio-economic status, one 
member of each pair having been promoted reg- 
ularly and the other having repeated some pre- 
vious grade. His findings showed a significant 
advantage for non-repeaters over repeaters in 
social and personal adjustment as revealed by 
the Symonds-Block Student Questionnaire. As 
Anfinson pointed out, it would have been better 
to have tested these irregular-progress pupils 
soon after the failure occurred; in some cases 
several years had elapsed. Inaddition, the 
range of measuring techniques was very limit- 
ed. The results of such questionnaires, when 
used without other sorts of evidence, must be 
handled with considerable reservation. 





Sandin used sociometrics, rating scales, 
check lists, observations, and interviews to 
study aspects of social and personal adjustment 
(36). In general, he found that nonpromoted 
children tended to choose companions from 
grades higher than their own, to be pointed out 
by classmates as children who associated with 
older pupils, and to be discriminatedagainst in 
the selection of study companions. This last 
finding did not hold true for the first grade, 
where nonpromoted children received signifi - 
cantly more than their expected share of choices. 
His findings concerning attitudes and feelings, 
described previously, disclosed a general out- 
look indicative of a less happy adjustment among 
slow-progress than among normal-progress 
pupils. Since Sandin made no attempt to equate 
the groups studied on other factors likely to af- 
fect social and personal adjustment, it is im- 
possible to weigh the contributing influence of 
the promotion factor. Sandin put his finger on 
this problem when he concluded: 


Itis necessary to conduct fur- 
ther study to discover to what extent 
children who might have been non-pro- 
moted according to grade standards, 
but who actually were promoted, show 
a better picture of adjustment than 
those who were held back (36). 
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Contribution of the Present Study 





The present investigation takes over where 
Sandin’s left off. Sandin raised the question as 
to whether his findings would have been any 
different even if his groups of 400 nonpromoted 
children had been promoted regularly. While it 
is impossible to know what would have happened 
to these particular children, it is possible to 
draw appropriate conclusions from the exper- 
iences of similar children under corresponding 
conditions. This study, then, makes its con- 
tribution to existing research by comparing the 
social and personal adjustment of equated groups 
of children subsequent to promotion and nonpro- 
motion. The following thesis statement gave 
direction to the investigation: During the year 
following promotion or nonpromotion, what dif- 
ferences in personal and social adjustment may 
be distinguished among promoted and nonpro- 
moted children of corresponding chronological 
age, mental age, and scholastic achievement 
level? 

Analysis of the thesis suggests two sorts of 
differences and three levels of treatment for 
data collected. The first differences are those 
between the two groups, regardless of similar- 
ities among children of both groups and of indi- 
vidual differences in reverse of general trend. 
The other differences are those existing among 
the members of any one group. This study is 
concerned with both types of differences. The 
first level of treating data is to reveal the ex- 
istence or non-existence of either type of differ- 
ence. Such treatment constitutes adequate an- 
alysis of the thesis; however, the value of the 
total study is enhanced by qualitative interpre- 
tation of differences. Consequently, this study 
further seeks to determine the relative advan- 
tages or disadvantages of any differences ident- 
ified and to evaluate, tentatively, the roles of 
promotion and nonpromotion in producing these 
differences. 


Plan of Approach 





In approaching this problem, a major diffi- 
culty was encountered in attempting to control 
all the many factors in the school situation cap- 
able of influencing the social and personal devel- 
opment of children. It was impossible to match 
schools, classrooms, teachers, and pupils on 
all but the factors of promotion and nonpromo- 
tion. Furthermore, since it was necessary to 
select the children early enough in the year to 
permit some preliminary evaluation of their 
personality growth, the time factor was a deter- 
rent to any very extensive matching procedure. 

Previous to initiating the study, the writer 
proposed the following plan for choosing the chil- 
dren to be studied: 
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1. Select a single school system, the schools 
of which represent a wide range of promotion 
rates. Thus, the need to equate school systems 
is eliminated, 

2. Early in the school year, select from five 
or more schools having relatively high nonpro- 
motion rates a total of at least fifty nonpromot- 
ed first-grade children. 

3. Equate this group with a group of second- 
grade children chosen from schools whose pat- 
rons represent comparable levels of socio-ec- 
onomic status. The factors to be equated are 
mental age, chronological age, and achievement, 
since significant differences between the groups 
in any one of these obviously would invalidate 
the findings. 

4. Check the progress records and health 
cards of all children selected. Eliminate from 
the groups all those suffering from physical 
handicaps, such as speech or eye defects, and 
all those obviously suffering from severe per- 
sonality disorders. 

It is important to attack the promotion prob- 
lem as early as possible in the school life of the 
child. A boy or girl who fails the sixth grade, 
for example, probably has experienced the ef- 
fects of several previous near-failures. For 
him, repeating that grade represents the repe- 
tition of only a fraction of his total schooling. 
For the first-grader, failure of the grade is not 
a cumulative experience. If this failing exper- 
ience is damaging to him, the damage should be 
revealed in his next year’s development, while 
he is still at a young and impressionable age. 
Failure at the end of the first year represents 
the failure of one hundred percent of a school 
career measured in grades. 

Implementing the plan establishes two groups 
of children selected from ten or more schools 
in one school system. The first group of fifty 
or more boys and girls is composed of nonpro- 
moted first graders, the second of promoted 
second-graders, both groups equated for mental 
age, chronological age, and achievement, and 
all children spending their second year inschool. 

Two major hypotheses, tested as null hypoth- 
eses, are set forth for investigation: 

1. There are no differences in social adjust- 
ment between the repeating and non-repeating 
groups of children. 

2. There are no differences in personal ad- 
justment between the repeating and non-repeat- 
ing groups of children. 

Since any division of the personality can be 
only arbitrary, it is desirable to relate the 
component parts wherever possible so that a 
picture of wholeness may be conceived, 

It is important that a child get along with 
his peers, that his teacher accept him ata 
level common to the other children, and that 
he be sure within himself that his status is 
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equivalent to that of his classmates. Evaluat- 
ing these conditions calls for the utilization of 
instruments which give the children opportunity 
to reveal how they feel about one another, in- 
struments which reveal how the teacher feels 
about each child, and instruments which reveal 
how the child feels about himself. It is not nec- 
essary to compare the results with any pre-de- 
termined standards of normalcy but simply to 
compare one group with the other and to deter- 
mine whether or not significant difference exists. 
Identifying differences is tantamount to accept- 
ing or rejecting the hypotheses. Inthe event 
that the null hypotheses are rejected, it is im- 
portant to determine the group favored by the 
differences and to formulate some assumptions 
to account for the presence of these differences. 


SECTION II 


EXPERIMENTAL DESIGN OF THE STUDY 


The Selection of Groups 





The schools. Six elementary schools 
irum which the nonpromoted children were to 
be chosen, were selected. The first-grade non- 
promotion rates in these schools for June, 1947, 
ranged from 12. 8 to 28.6 percent. By checking 
with the central office, it was made certain that 
these schools did not represent the most urban 
or most rural sections of the county or the up- 
permost group in socio-economic status. The 
fathers were largely textile millworkers, rail- 
road employees, small shop owners, truck and 
cab drivers, carpenters, painters, plumbers, 
welders, clerks, mechanics, and laborers, with 
only a very small number of professional men 
represented, 

Five elementary schools, from which the 
promoted children were to be chosen, were then 
selected. The first-grade nonpromotion rates 
for this group for June 1947, ranged from 5. 1 
to 11.2 percent. As for the first group, the 
most rural and urban areas were excluded, and 
the fathers represented the skilled, semi-skilled 
and laboring occupations, with only a very small 
proportion of professional families included. 

The children. —The cumulative progress and 
health records of the first six schools were ex- 
amined in order to select a tentative group of 
nonpromoted first-graders. All those who were 
repeating the grade for the second time, or who 
had severe physical handicaps, were eliminated. 
Seventy-three nonpromoted children, represent- 
ing twelve first-grade classrooms, remained. 

Each of the first-grade teachers in these five 
schools was asked to name the ten children pro- 
moted to grade two the previous June about whose 
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readiness for this grade she was most doubtful. 
Approximately 150 children were selected in 
this manner. Thus, had the nonpromotion rates 
of these classrooms been on a par with those of 
the nonpromoted group a considerable propor- 
tion of these 150 boys and girls would have re- 
peated grade one. From this number, those 
who had spent two years in grade one and those 
with obvious physical handicaps were eliminat- 
ed. Those remaining were tested to equate a 
group of them with the nonpromoted group on 
the basis of chronological age, mental age, and 
achievement. 

Equating the groups. —Kuhlmann-Anderson 
Tests (Grade I, Special) were administered to 
all children for the purpose of securing the ment- 
alages. To obtain the achievement quotient, 
the Metropolitan Achievement Tests (Form R, 
Primary I Battery for grade one and Primary 
II Battery for grade two) were used. 

Given the chronological age, mental age, and 
achievement quotients of the preliminary groups 
of promoted and nonpromoted children, the se- 
lection of final equated groups was largely a 
process of trial-and-error. Because ofthe rel- 
ative homogeneity in chronological age even be- 
fore the actual equating took place, it was pos- 
sible to concentrate on securing approximately 
comparable distributions for the other factors. 
It was necessary to maintain several extra cases 
in each group to allow for drop-outs and trans- 
fers so that two adequate samples remained at 
June 1948, when all data had been collected. 





Selection of Evaluation Instruments 





Collecting the data. —The evaluation instru- 
ments, their purposes and application, aresum- 
marized in Table I. 

Discussion of validity and reliability is omit- 
ted here because of space limitations. The fol- 
lowing points are pertinent to any consideration 
of appropriateness of the instruments to the job 
to be done: 





1. The Kuhlmann-Anderson Tests areat least 
as valid as any others of the paper-and-pencil 
type to measure intelligence at this age level. 

2. The Metropolitan Achievement Tests were 
found to be well suited to the curriculum organ- 
ization of the schools selected at the time the 
study was conducted. 

3. The fact that many of the subsections of 
the California Test of Personality are not dis- 
crete does not detract from the value of the 
individual items in differentiating between groups. 
This is a self-rating device. 

4. The Haggerty-Olson-Wickman Behavior 
Rating Schedules are useful in objectifying 
teachers’ observations of boys and girls. Re- 
sults of their use provide valuable insights in- 
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TABLE I 


EVALUATION INSTRUMENTS 





Purpose Instrument Application 





A. To Equate Groups 
1. For Mental Age Kuhlmann-Anderson 
Intelligence Tests 
Grade I (Special) Both Groups 


2. For Achievement Metropolitan 
Achievement Test, 
Form R 
Primary I Battery Nonpromoted Group 
Primary II Battery Promoted Group 


B. To Evaluate Adjust- 
ment 
1. Self-Rating California Test of 
Personality, Primary 
Series Both Groups 


2. Peer-Rating Sociometric Questions Both Groups 


3. Teacher-Rating Haggerty-Olson- 
Wiskman Behavior 
Rating Schedules 
Schedule A 
Schedule B (Div. I 
and Div. IV) Both Groups 





TABLE I 


THE HAGGERTY-OLSON-WICKMAN BEHAVIOR RATING SCHEDULES 
DISTRIBUTION OF CHILDREN’S SCORES ON SCHEDULE A 





Range Promoted Group Nonpromoted Group 





109. 5-119. 0 


99. 5-109. 
89.5- 99. 
79.5- 89. 
69.5- 79. 
59.5- 69. 
49.5- 59. 
39.5- 49. 
29.5- 39. 
19.5- 29. 
9.5- 19. 
0.0- 9. 


_ 
SInwwownodoc = 


Vo aaaaa»aa aw 
CoV aAanmwvuawr coo 


_ 
> oo 
lanl 





Number 
Mean 
S.D. 
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to children’s social adjustment and into the 
emotional areas of self-adjustment. 

5. To secure peer-rating data, each promot- 
ed and nonpromoted child was asked to name: 

a. The three children in his ownclass- 
room whom he would like to have as 
his very best friends. 

. Three children in his own classroom 
whom he would not care to have as best 
friends. 


With a major purpose of this study being to 
determine how well promoted and nonpromoted 
children fit into the groups of which they are 
members, this sociometric technique yielded 
very valuable evidence. 

By the end of the school year, the following 
data were available for analysis: 


i. Results of the California Test of Person- 
ality, administered to each child first in Octo- 
ber or November and again in May. 

2. The answers to two best-friend sociomet- 
ric questions, the first indicating choices and 
the second rejections of other children in the 
room, asked of each child in each of the twenty- 
three classrooms in October or November and 
repeated in May. 

3. Ratings on the Haggerty-Olson-Wickman 
Behavior Rating Schedules secured of each child 
in May 1948. 


Summarizing the data. ~The data having been 
collected, the next step was the summarization 
of results in terms of test scores and numbers 
of children. Total raw scores for Self-Adjust- 
ment, and the twelve subsections of the Califor- 
nia Test of Personality were computed for both 
initial and end testings. Data for sociometric 
acceptance and rejection were computed in both 
percentile and percentage form, the former to 
show the position of each child in his class and 
the latter to show the proportion of total choices 
or rejections received by each child. The Hag- 
gerty-Olson-Wickman data were summarizedin 
total weighted scores, by Schedules and by sub- 
sections. Means and standard deviations then 
were computed for each distribution. 

In order to identify those items that discrim- 
inated between the groups, the distributions of 
promoted and nonpromoted children on each it- 
em of the California Test of Personality andthe 
Haggerty-Olson-Wickman Behavior Rating Sched- 
ules were summarized. Then, to further clar- 
ify friendship patterns, all instances of socio- 
metric mutual acceptance were tabulated. Fin- 
ally, the scores for each child on all instru- 
ments were checked in order to see if any pat- 
terns of consistently low or high scores per- 
tained. 

Analyzing the data. —The following steps 
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were followed in analyzing the data: 

1. Examination and statistical treatment of 
the summaries described above to see if any 
major group differences could be identified. 

2. Examination and statistical treatment of 
the distributions on single items to see what, 
if any, items discriminated significantly between 
the groups. 

3. Synthesis of all significant results to i- 
dentify any patterns of group differences. 

4. Acceptance or rejection of the two null 
hypotheses relative to social and personal ad- 
justment. 

5. Qualitative comparison of differences to 
determine in what areas and to what extent one 
group might be considered better adjusted than 
the other. 

6. Further probing into the nature of these 
differences to determine if logical explanations 
for their presence could be found, 

7. Formulation of recommendations as indi- 
cated by the findings. 


SECTION II 
ANALYSIS OF THE SELF-RATING DATA 


California Test Findings 





Striking similarities in both initial and final 
performances of the two groups on the Califor- 
nia Test of Personality were revealed. In Total 
Adjustment, both groups made identical mean 
gains of 0.9, the promoted group moving from 
a mean of 61.9 to one of 62.8, while the non- 
promoted group shifted from 60.7 to 61.6. A 
downward trend occurred only in Self-Adjust- 
ment, the nonpromoted group dropping from a 
mean of 30. 4 to one of 29.4. The promoted 
group, however, increased an average of 0. 6 
raw score points, from 30.3 to 30.9. Both pro- 
moted and nonpromoted groups increased slight- 
ly from first to final testings in Social Adjust- 
ment, from 30.9 to 31. 6 and from 32. 2 to 32.3, 
respectively. 

The shifts in mean raw scores from first 
to second testings slightly favored the promoted 
group for Self-Reliance, Freedom from With- 
drawing Tendencies, Freedom from Nervous 
Symptoms, Social Standards, Social Skills, and 
Freedom from Anti-Social Tendencies. By the 
same criterion, the shift was to the advantage 
of the nonpromoted group on Sense of Personal 
Worth, Sense of Personal Freedom, Feeling of 
Belonging, Family Relations, School Relations, 
and Community Relations. In one instance, the 
advantage accrued to one group only because the 
mean remained constant while that of the other 
dropped slightly; in another, the advantage came 
about by the mean of one dropping less than that 
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of the other. 

The California Test of Personality is socon- 
structed that a high score is considered indica- 
tive of a high level of adjustment. Such being 
the case, mean raw score differences favored 
neither group on Total Adjustment, were slight- 
ly to the advantage of the promoted group on 
the two subsections, Self and Social Adjust- 
ment, and favored the groups almost alternately 
on the twelve component categories. A vital 
question arose at this point: With what degree 
of confidence may these differences be accepted 
as true ones, not resulting simply by chance? 
That is, what assurance is there that these 
findings would not be reversed with repeated 
experiments of a similar nature? The signifi- 
cance of the differences between the groups was 
tested by the regression technique described by 
Peters and Van Voorhis (34). 


Statistical Significance of the Findings 





It will be recalled that the children in the 
promoted group were not matched, case for case, 
with those in the nonpromoted group. Rather, 
the groups were equated—that is, arranged in 
equitable distributions—for chronological age, 
mental age, and achievement. The regression 
technique provides for a hypothetical matching 
of groups, thus obviating the necessity of hav- 
ing precisely matched pairs. The theoretical 
regression of one group is predicted from the 
actual regression of the other. To illustrate, 
using the promoted group as the control, the re- 
gression of end scores (May testing) upon initial 
scores (October-November) was determined. 
Acting on the assumption that the experimental 
group (nonpromoted children) developed in the 
same fashion as the control group, the end 
score for each nonpromoted child was predicted 
from his initial score. The formula is 


X}= r 22 (x,)+ (M, - r 2 M,) 
a; 0, 


where X, and X} are the initial and predicted 
scores, r is the correlation coefficient obtained 
by correlating initial scores with end scores for 
the promoted group, M, and Mj are initial and 
final means, respectively, and 0, and 0, are 
the initial and final standard deviations of the 
entire promoted group. Then, by comparing 
the end scores actually obtained by nonpromot- 
ed children with the scores predicted for them, 
the significance of group differences was indi- 
cated as illustrated below. 

Total adjus . — This formula was 
then applied to the California Test scores. In- 
itial and end scores on Total Adjustment for the 
promoted group correlated .583. Substituting 
the appropriate means and standard deviations 
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in the formula produced the following: 


x! « 583 12-4 x, + (62.8 - 503 42-4 61.9) 


Simplifying, and substituting Yj and Y, for 
X} and X, to represent predicted and initial 
scores of nonpromoted children, the equation 
became Y} =.700Y, + 19.5. This equation 
was then used to predict the scores for each 
member of the nonpromoted group by substitut- 
ing initial scores for Y,. Thus, the predicted 
score for the first nonpromoted child, whose 
initial Total Adjustment score was 61, wascom- 
puted to be 62.2. It was found that the nonpro- 
moted group, on the final testing, fell short of 
the predicted expectancy by an average of .465 
raw score points per child. 

In order to find the statistical significance 
of this difference, the standard error of the dif- 
ference was first computed using the formula 








——, /oxf(l-r&ixg) o% yy! (xi-yioxg(i-rxyxp) 
oy-y'= + + > 
Nyx - 1 Ny +4 (Nx- 1)0x; 


where the subscripts i and f stand for initialand 
final scores, respectively, and where x refers 
to the promoted group and y the nonpromoted. 
By substituting values where o*y - y' became 
9.40, the equation was as shown at top of next 
page. Dividing the mean difference by the stand- 
ard error of this difference produced a critical 
ratio of 0. 258 as follows: 


. 485 
c. R. = 1. 882 = 0. 258. 


The probability (from tables) of obtaining a dev- 
iate greater than this value in either directionis 
.794, an extremely large probability. It may be 
concluded that there are no significant differences 
between the promoted and nonpromoted groups 
for Total Adjustment on the California Test of 
Personality. The null hypothesis that there are 
no differences is retained. 

Self and social adjustment scores. —The pro- 
cedure for using the regression technique and 
testing the significance of the difference between 
predicted and attained scores has beendescribed 
in considerable detail, since this was the pro- 
cedure followed in analyzing major group differ- 
ences on all three types of data. The correla- 
tion of initial and final Self-Adjustment scores 
of promoted children was .513. Substituting this 
figure together with data in the regression form- 
ula, produced the prediction equation Y2 = .641Y, 
+ 11.63. Nonpromoted group scores were then 
predicted from this equation. Attained scores 
fell short of predicted scores, on the average, 
by 0.673 raw score points. The standard error 
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oy -7* = [24 (1 - 583°) 


of this difference wa» 1.132, which, divided in- 
to the mean difference, produced a quotient of 
0.595. Reference to a table of integrals of the 
normal curve showed that, if the true difference 
were zero, a difference of .595 standarderrors 
could be expected in , 548 of the trials while the 
opposite could be expected in . 452 of the trials. 
Again, the null hypothesis that there are no dif- 
ferences between the groups on the Self-Adjust- 
ment phase of the Caiifornia Test of Personality 
is retained, 

The shift from inmfial to final mean scores 
favored the promoted group both for Self- and 
Social Adjustment buf to a slightly greater de - 
gree for the former. There was no need, there- 
fore, to analyze the data for Social Adjustment 
any further. It was «ssumed that the difference 
was not statistically significant, and so the null 
hypothesis that there are no differences stands. 

Subsection scores; —The greatest shift in 
mean scores for the two groups of children oc- 
curred on the subsection, Freedom from Anti- 
Social Tendencies. Correlating initial with end 
scores for promoted children produced a coef- 
ficient of .421. Substituting the proper values 
in the prediction for:mula produced the equation 
Y; = -5O9Y, + 2.44. _The scores actually at- 
tained by the nonpromoted children fell short of 
the scores predicted for them, an average of 
.293 raw score pointy. The standard error of 
this difference was . 439 which, when divided in- 
to .293, gave a critival ratio of .667. The dif- 
ference, then, was not significant. 

Data for the remaining eleven subsections 
were not analyzed, since the shift in meanscores 
for Freedom from Asti-Social Tendencies was 
the greatest and sinc? the difference between 
groups on this subsegtion was not significant. 





} 
{ 

Purpose of the anjlysis. —It was pointed out 
in Section II that not 411 of the subsections on 
the California Test of Personality are discrete. 
Certain items can be jtransferred from one cate- 
gory to another with«dit contradicting the titles 
of their new subsectijns. This situation, while 
detracting from the value of the subsection does 
not change the validi‘y of the item when examin- 
ed on its own merits; Therefore, an examina- 
tion of the distribution of the groups on each of 
the 96 items constituéing the test was undertaken 
in order to further tl» purposes of this study in 
the following ways: 











9.40? | (61.9 - 60.7)* 12.47 (1 - .583*) 
54 


54(10.3?) 


1. To identify any single items that clearly 
discriminated between the groups. 

2. To identify any patterns of group differ- 
ences through meaningful combinations of dis- 
criminating items. 

3. To identify possible leads for further ex- 
ploration or research. 

Results of the analysis. —The following items 
were selected as offering greatest promise for 
discriminating significantly between the groups 
in the area of Self-Adjustment: 1 and 4 under 
Self-Reliance; 5 and 6 under Sense of Personal 
Worth; 1 and 6 under Feeling of Belonging; 1, 2, 
and 4 under Freedom from Withdrawing Tenden- 
cies; and 2 and 4 under Freedom from Nervous 
Symptoms. The following items were selected 
as revealing greatest differences between the 
groups in Social Adjustment: 1,4 and 7 under 
Social Standards; 2 and 7 under Social Skilis; 
2,4 and 8 under Freedom from Anti-Social Ten- 
dencies; 2,3 and 8 under Family Relations; 1, 2, 
4 and 5 under School Relations; and 6 and 8 un- 
der Community Relations. Whenever a group 
changed its score by eight or more persons on 
any given item from initial to final testing, that 
item was included in the above list unless the 
other group also changed its score in the same 
direction. Several, but not all, of the items 
representing a shift of seven persons were in- 
cluded for trial purposes. Had such a shift 
proven Statistically significant, the other items 
also would have been tested. In three instances 
(items 6 under Sense of Personal Worth, 1 un- 
der Feeling of Belonging, and 7 under Social 
Skills), items were chosen when they represent- 
ed ranges of only six persons between the results 
of initial and final testings or between groups on 
any one testing. These are items on which a 
large proportion of one or both groups scored 
correctly; it was found, as is to be expected, that 
it required a smaller shift to produce significant 
results under these circumstances than when 
the members of the group were more evenly dis- 
tributed between right and wrong answers. 

Techniques for testing the significance of dif- 
ferences. —Testing the statistical significance 
of the above data presented the complex problem 
of comparing two groups on two testings for 
single items. Two techniques were used, each 
being utilized to do a different job. The first 
was applied to those situations where items dis- 
criminated between the groups on one testing 
but did not do so on the other. The other was 
used to test shifts made by the children ofany 











June, 1954) 


one group, no matter how the two groups com- 
pared on either testing. 

The data for item 6 under Feeling of Belong- 
ing are used to illustrate the first of these tech- 
niques. The first time the test was administer- 
ed, 33 promoted and 46 nonpromoted children 
answered the question in the way deemed desir- 
able by the test-makers. On the second testing, 
however, 37 promoted and 37 nonpromoted child- 
ren answered the question in this way. The lat- 
ter group dropped 9 persons, while the former 
increased 4; differences apparent on the first 
testing no longer existed. The 33 promoted child- 
ren represented 60. 0 percent of the group; the 
46 nonpromoted children represented 83.6 per- 
cent of their group. The difference between the 
two percentages was 23.6. The standard error 
of this difference was determined from the form- 
ula 


Pidi + Pade 


oD} = 100 
N, Nz 


where p, and q, are the proportions of the pro- 
moted group, and where pz and q, are the pro- 

portions of the nonpromoted group scoring right 
and wrong. This is the formula for computing 
the standard error of the difference between two 
uncorrelated percentages (19). Substituting, the 
equation became 


oD% = 100 / .964%.036 , .855.145 _ 5 3g 
55 55 








The critical ratio then, was 3 = 2.03. From 
a table of integrals, the probability of obtaining 
a difference of such magnitude was found to be 
.004. This difference, therefore, is significant 
at considerably better than the 1 percent level.* 
The other technique is illustrated by analysis 
of the data for item 4 under Freedom from With- 
drawing Tendencies. On this item, the promot- 
ed group increased from 18 children answering 
correctly on the initial testing to 19 so answer- 
ing at the end of the year. The nonpromoted 
group, meanwhile, dropped from 26 to 7. The 
purpose this time is to test the significance of 
this nonpromoted group decline. Only 12.7 per- 
cent of the nonpromoted group on the final test- 
ing, as compared to 47.3 percent at the begin- 
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ning, scored correctly on this item, a differ- 
ence of 34.6 percent. Again, the problem was 
one of testing the differences between propor- 
tions. This time, however, since the group of 
55 children was the same on both trials, a cor- 
relation factor was involved. However, thecor- 
relation coefficients indicating the amount of 
agreement between first and second testings on 
Single items were not available. Therefore, in 
order to employ a conservation computation, 
this correlation was assumed to be zero. The 
equation for computing the standard error of the 
difference between correlated proportions is 


oD% = 100 / Pid: , P2de -2ri2 / Pid: P24e 
N, N2 N,Nz 


where r,, is the correlation between initial and 
end nonpromoted scores on the given item. Ob- 
viously, the value of the entire expression in- 
volving the correlation coefficient is zero. Sub- 
Stituting for the selected sample, the equation 
became 


oD} = 100 / 473x.527 + .127 x .873 -2(.379) 
55 55 











473 x 527 127.873 ~ 6 59 
55 x55 





Dividing this figure into 34.6, the difference, 
produced a critical ratio of 5.31. The probabil- 
ity of obtaining a deviate greater than this value 
in either direction is less than .001. The null 
hypothesis that there were no differences between 
the groups is rejected and it is assumed that 
there was a statistically significant difference 
in favor of the promoted group on this item. 

Results cof the statistical analysis. — Items 
which discriminated significantly between the 
groups at or within the arbitrary confidence 
levels of 5 and 1 percent are listed below. The 
list represents a summary of all significant dif- 
ferences discovered from utilization of the Cal- 
ifornia Test of Personality. 

The following items represent differences 
that are significant at better than the 1 percent 
level of confidence: 





1. Do the children ask you to play with them ? 
The nonpromoted group gained significantly (0.4 








#It has been pointed out that smaller differences were required at the tails of the distribution to 
produce statistical significance. It is recommended that, for such cases, the hypothetical true 
proportion rather than the observed proportion be used, a procedure that produces slightly more con- 
servative results. Examination of the present data, however, revealed that utilization of this al- 
ternative technique resulted in only some minor changes that were taken care of within the broad 
significance levels (1 ami 5 percent). This technique is described by E. F. Lindquist, A First 
Course in Statistics (Boston: Houghton Mifflin Co., 192), ppe 12%129. 








310 JOURNAL OF EXPERIMENTAL EDUCATION 


percent) from initial to final testing. However, 
a Slight but statistically insignificant gain on 
this item for the promoted group must be taken 
into consideration in interpreting this difference. 

2. Do you think other children do not like 
you? The promoted group gained significantly 
(0. 4 percent) while the nonpromoted group drop- 
ped on this item, both scoring evenly on the final 
testing. 

3. Do you like to stay away from many of the 
children? Slightly more nonpromoted than pro- 
moted children answered this question correctly 
on the initial trial, a difference that was not statis- 
tically significant. However, on the final trial, 
more promoted than nonpromoted children an- 
swered correctly, a difference that was signif- 
icant at the 0. 4 percent level. 

4. Would you rather think about nice things 
than play? The nonpromoted group dropped sig- 
nificantly (better than 0.1 percent), while the 
promoted group improved slightly from initial 
to final testings. 

5. Do you have many colds? The promoted 
group improved significantly (0.6 percent) while 
the nonpromoted group declined almost as sig- 
nificantly. 

6. Should one be nicer to bright children than 
to others? The promoted group increased sig- 
nificantly (1. 0 percent), while the nonpromoted 
group lost ground on this item. 

7. Do many people you know say mean things 
about you? The promoted group increased sig- 
nificantly (better than 0.1 percent), while the 
nonpromoted group declined. The latter group 
was still slightly ahead on the final trial. 

8. Do your parents criticize you a lot but 
seldom praise you? The promoted group de - 
creased markedly (better than 0.1 percent) while 
the nonpromoted group decreased only slightly. 

The following items revealed differences that 
were significant within the 5 percent level: 

1. Do the children think you are afraid of 
things? The nonpromoted group gained signifi- 
cantly (estimated by comparison with similar 
differences, to be at the 3.0 percent level) on 
this item. This gain was offset somewhat by a 
Slight but insignificant gain by the promoted 
group. 

2. Do the other children like to have you with 
them’? The promoted group dropped while the 
nonpromoted gained slightly, the same number 
of children in both groups scoring correctly on 
this item on the final testing. The initial differ- 
ence was significantly in favor of the promoted 
group (4.2 percent); no differences existed on 
the final trial. 

3. Should a person always be nice to those 
who win from him in games? The nonpromoted 
group remained constant from first to final test- 
ings on this item, while the promoted group in- 
creased significantly (2.0 percent). 
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4. Do you tell mean children what you think 
of them? The promoted group improved signif- 
icantly (4.4 percent) from initial to end trials, 
while the nonpromoted group declined almostas 
markedly. 

5. Do many of the children start quarrels 
with you? The nonpromoted group declined 
Slightly, while the promoted group improved 
significantly (4. 4 percent). 

6. Do people try to argue with youa great 
deal? Slightly fewer promoted children ans- 
wered correctly on the final trial than had ans- 
wered correctly on the initial trial; markedly 
fewer nonpromoted children answered correct- 
ly on the final trial (2.4 percent). 

7. Do you feel that no one loves youat home ? 
The nonpromoted group fell only slightly from 
first to final testing on this item, while the pro- 
moted group fell significantly (3.2 percent). 

8. Is it hard to talk things over with your 
folks because they don’t understand? The pro- 
moted group increased slightly on this item 
while the nonpromoted group declined signifi- 
cantly (2.0 percent). 

9. Are you often unhappy because of getting 
low_marks in school? Slightly fewer nonpro- 
moted children answered this question correct- 
ly on the final trial than on the initialtrial, while 
significantly fewer (3.2 percent) promoted chil- 
dren answered correctly on the final trial than 
on the initial trial. 

10. Do your classmates often say things that 
hurt your feelings? The nonpromoted group de- 
clined on this item while the promoted group 
increased significantly (estimated by compari- 
son with similar shifts on other items to be at 
the 3. 0 percent level). 

11. Do you think that most of the children in 
your school are trying to keep you away from 
them? While the nonpromoted group declined 
on this item, the promoted group increased sig- 
nificantly (estimated by comparison with similar 
gains on other items to be at the 3. 0 percent 
level). 

12. Are conditions of your neighborhood as 
good as you would like to have them? The non- 
promoted group dropped only very slightly on 
this item and the promoted group dropped sig- 
nificantly, a drop that was estimated by compar- 
ison with other items to be at the 3. 0 percent 
level. 












































Twenty items from the California Test of Per- 
sonality have been identified as discriminating 
between the groups at confidence levels ranging 
from 5 percent to better than 1 percent. Of the 
twenty significant items identified, thirteen dis- 
criminated in favor of the promoted group and 
only seven in favor of the nonpromoted. These 
findings, together with those of the two succeed- 
ing sections, are brought into meaningful pat- 
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terns and are interpreted in the light of the ma- 
jor hypotheses in Section IV. 


SECTION IV 
ANALYSIS OF THE PEER-RATING DATA 
Introduction 


This section presents and analyzes the re- 
sults of the sociometric questions, whereby the 
children indicated their acceptance or rejection 
of one another. Each child in the twenty-three 
participating classrooms was asked to name 
the three children he would like to have and the 
three children he would not like to have as very 
best friends. These questions were asked both 
near the beginning and towards the end of the 
school year. When all the data had been com~ 
piled, a few gaps were apparent, making it im- 


possible to present complete sociometric results. 


Consequently, all computations in this section 
are based upon 52 promoted and 51 nonpromot- 
ed children. 


Sociometric Findings 





Nature of the data. —The sociometric data 
are presented in both percentile and raw per- 
centage form. Both were computed for each 
child on the basis of the finings for the class - 
room of which he was a member. Thus, for 
percentiles, each child in the room was arranged 
in descending order of total choices received 
and then a percentile rank assigned according 
to his position in his sex group. It was consid- 
ered preferable to rank separately for eachsex. 
In a room where 60 of the total choices were 
received by boys, a boy receiving 2 choices 
from boys and 1 from girls was credited with 
3 choices or 5 percent of the toal and was as- 
signed a percentile rank according to his place- 
ment among males. 

These data indicate a given child’s relation- 
ship to his peers in two different ways. Percent- 
iles show quickly how a child ranks in relation 
to the others of his group. However, this is a_ 
purely relationship computation that completely 
hides the nature of the original quantitative dis- 
tribution. It hides, for example, quantitative 
differences where two children, one receiving 
ten choices and the other only four, are bothat 
the ninetieth percentile in their respective 
groups. Such illustrations occurred in the pres- 
ent study when, in one classroom, two or three 
children secured a disproportionately large num- 
ber of choices or rejections while, in another, 
the selections were spread out fairly evenly 
over the entire group. The use of percentage 
scores tends to remedy this situation. 
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Percentile scores. — Highscores for choices 
and low scores for rejections are indicative of 
desirable social adjustment. In choices, the 
promoted group ranked below the theoretical 
mean of 50 for a normal distribution but im - 
proved from a mean of 37.2 to one of 42. 4. 
The nonpromoted children, meanwhile, moved 
downward from a mean percentile score of 55.1 
to one of 45.9. In rejections, the promoted 
group improved its position by dropping from 
51.6 to 44.5, while the nonpromoted group re- 
mained constant with means of 57.4. The trends 
were to the advantage of the promoted group in 
all instances. However, in spite of its substan- 
tialdropin relative popularity, the nonpruomot- 
ed group maintained higher percentile means 
for choices at both first and final testings. Ad- 
versely, this situation was true for the nonpro- 
moted children in regard also to their rejection 
picture. 

In regard to choices, 29 promoted children 
improved over their initial positions, 22 de- 
creased in their group standings, and 1 remained 
the same. In rejections, 21 promoted children 
improved their positions by obtaining a lower 
score, 18 received a higher rejection rating, 
and 3 remained constant. Twenty-four nonpro- 
moted children improved their standing in 
choices, while 27 lowered in rank. Twenty-five 
of this group improved their rejection picture, 
while 23 shifted for the worse, and 3 revealed 
no Change. Once again, the nature of the shifts 
favored the promoted group. 

Percentage scores. —The percentile findings 
now may be compared with the results expres- 
sed in percentages of the total selections made 
in each classroom. The promoted group in- 
creased from a mean of 2. 56 percent to one of 
3.96, while the nonpromoted group decreased 
from 6.30 to 6.11. Although the direction of 
the shift again is to the advantage of the promot- 
ed group, the nonpromoted group maintained 
considerably higher meanscores at both fall and 
spring testings. The higher means of the latter 
were produced in part by a few scores scatter- 
ing well above the bulk of the scores in the dis- 
tribution. The shift in both groups from initial 
to final testings was very pronounced at the ex- 
treme lower end of the distribution, Although 
26 promoted children received scores of less 
than 2 percent of all the choices received by 
their sex in their rooms when questioned inOc-~- 
tober or November, only 11 were so rated in 
May. Only 5 nonpromoted children fell into 
this category when the sociometric questions 
were first asked, but 17 occupied this position 
when the questions were repeated. It is ob- 
vious that the number of social ‘‘isolates’’ and 
‘‘fringers’’—that is, the number of children 
not wanted or little wanted for friends—in- 
creased markedly for the nonpromoted group 
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and declined considerably for the promoted 
group. 

The trend indicated by the shifts in meanper- 
centages is verified by the shifts made by indi- 
viduals. Thirty promoted children to 20 non- 
promoted children improved their standing, 12 
promoted to 24 nonpromoted cases lost ground, 
and 10 promoted to 7 nonpromoted children re- 
mained constant. This situation clearly is to 
the advantage of the promoted group. 

In regard to rejection, the promoted group 
improved by dropping from a mean percentage 
of 6. 94 to one of 5.15. Meanwhile, the means 
for the nonpromoted group shifted from 6.94 to 
8.35. The changed picture from initial to final 
testings is again to the advantage of the promot- 
ed group. Comparing the directions of the shift 
by individuals, 14 promoted and 20 nonpromot- 
ed children received higher percentages of their 
rooms’ total rejections on the final questioning; 
19 promoted and 25 nonpromoted children re - 
ceived lower percentages; 19 promoted and 6 
nonpromoted children remained the same. 

On the first testing, 25 promoted children 
each received less than 3 percent of the total re- 
jections cast in their respective rooms, where- 
as only 17 nonpromoted children were so rated. 
Thus, almost fifty percent of the promoted group 
had only the two alternatives of increasing their 
score or remaining the same when the questions 
were repeated—they could not possibly lower 
their scores, It is not surprising, then, that 
so many promoted children, in contrast to so 
few nonpromoted children, received the same 
percentage scores on both testings. While both 
groups improved at the lower end of the scale, 
the promoted group moving from 25 to 30 and 
the nonpromoted group from 17 to 20 children 
receiving less than 3 percent of the rejections, 


the advantages here are with the promoted group. 


Summary. —In summary, the sociometric 
data revealed trends favoring the promoted 
group. Generally speaking, the promoted child- 
ren tended to become more accepted as friends 
and less rejected as persons not considered de- 
sirable as friends. The reverse held true for 
the nonpromoted group. The nonpromotedchild- 
ren, over the promoted children, tended to be 
selected relatively more often by classmatesas 
being both wanted and not wanted for very best 
friends. The range from the positive, or ‘‘lik- 
ing, ’’ side of the scale to the negative, or ‘‘not 
liking, ’’ side was greater for the nonpromoted 
than for the promoted group. 

Are these findings statistically significant? 
Would they be reversed with subsequent exper- 
imentation? Answers to these questions were 
sought once again through application of the re- 
gression technique, as described in the prev - 
ious section, and are presented in the succeed- 
ing section. 
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Statistical Significance of the Findings 





Percentile scores. —lInitial and final accept- 
ance scores for the promoted group correlated 
.327. Nonpromoted group end scores were pre- 
dicted from the equation Y} = .38Y, + 28.41 and 
exceeded actually attained end scores by the 
mean difference between the two of 1.24. This 
difference divided by its standard error of 5.83, 
produced a critical ratio of .213. The proba- 
bility of obtaining a deviate greater than this 
value in either direction is .834. The null hy- 
pothesis that there are no differences between 
the promoted and the nonpromoted children on 
percentile ratings for social acceptance is re- 
tained. 

In regard to the rejection picture, correlat- 
ing initial and end scores of promoted children 
produced a coefficient of .358. Theoreticalend 
scores for nonpromoted children were predict- 
ed from the equation Y} = .36Y, + 5.84. Attained 
scores exceeded predicted scores by a meandif- 
ference of 11.28. In this case, an undesirable 
situation is implied by attained scores being in 
excess of predicted scores, since the factor in- 
volved is social rejection. The standard error 
of the difference was 4.99, which, when divided 
into this difference, produced a critical ratio of 
2.26. The probability of obtaining a deviate 
greater than this value in either direction is 
.024. The null hypothesis that there are no dif- 
ferences between the promoted and the nonpro- 
moted children in regard to sociometric rejec- 
tion may be rejected at the 2. 4 percent level of 
statistical significance. 

Percentage scores. —On choices, initialand 
end raw percentage scores for the promoted 
children correlated .490. Nonpromoted end 
scores were predicted from the equation Y} = 
.495 + 2.69 and fell short of actually attained 
scores by an average of .273 points per pupil. 
This time, a desirable situation is indicated by 
attained scores being in excess of predicted 
scores, since social acceptance is being con- 
sidered. The standard error of this difference 
was 1.05. Mean difference divided by its stand- 
ard error produced a critical ratio of .250. 
From tables, the probability of obtaining a dev- 
iate numerically larger than .250 is .804. The 
null hypothesis that there are no differences be- 
tween the groups on this set of data is retained. 

Correlating initial and final scores on socio- 
metric rejection (raw percentage scores) for 
the promoted group gave a coefficient of . 391. 
End scores for the nonpromoted group were pre- 
dicted from the equation Y} = .35Y, + 2. 65, 
and then compared with final attained scores. 
Attained scores exceeded predicted scores by 
a mean difference of 3.11. The standard error 
of this difference was 1.75 which, when divid- 
ed into 3.11, produced a critical ratio of 1.78. 
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This difference, then, favoring the promoted 
group, is significant at about the 7.0 percent 
level and is not great enough to be accepted with 
the conventional degree of confidence, However, 
differences of this magnitude must not be over- 
looked, since they serve a definite purpose in 
strengthening or balancing differences identified 
by other means. 

Summary. —The foregoing analysis of the 
Statistical significance of sociometric findings 
revealed the following: 


1. For acceptance as revealed by choices re- 
ceived: a slight but statistically insignificant 
advantage for the promoted group on data com- 
puted ona percentile basis; a slight and equally 
insignificant advantage for the nonpromoted group 
on data computed in percentages. 

2. For rejection: advantages for the promot- 
ed group on both percentile data (92 percent lev- 
el of confidence) and percentage data (7 percent 
level). 


An Index of Adjustment 





Computation of the index. — The analysis pre- 
sented in the preceding section was based, in 
part, on the assumption that position of two 
groups On a continuum of sociometric accept- 
ance or rejection is indicative of relative adjust- 
ment. High scores for acceptance and low scores 
for rejection, then, indicate a desirable picture 
of adjustment, while low scores for acceptance 
and high scores for rejection indicate a less 
desirable picture. In certain instances, these 
statements might not apply. It might be better 
for the development of the individual concerned, 
for example, to be sufficiently ‘‘outwardgoing’’ 
to incur dislike than to be so completely ‘‘color- 
less’’ as to draw neither the acceptance nor the 
rejection of his peers. Applied in a general way, 
however, the assumption appears to be a sound 
one, 

Data for acceptance and rejection were anal- 
yzed separately in the preceding section. No 
attempt was made there to pair choices and re- 
jections for any given individual to show the com- 
bined picture of adjustment. Such an attempt 
was made by computing an ‘‘index of total ad- 
justment’’ for each child, using the percentile 
data. It will be recalled that percentile ranks 
were assigned to boys, for instance, according 
to their relative positions among all the other 
boys in their own classrooms. A boy receiving 
a percentile rank of less than 25 for choices, 
then, ranked in the bottom quarter of his class 
group and was assigned an acceptance index of 
1. Those with ranks of from 26 to 50 were in 
the second lowest quarter and were assignedan 
index of 2, andsoon. For rejection, however, 
a low score is more desirable than a high one, 
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according to the assumption expressed above. 
Low scores for acceptance and high scores for 
rejection represent two criteria of undesirabil- 
ity and so were equally weighted. Childrenwith 
percentile ratings for rejection of 76 or more 
ranked in the top quarter and were assigned an 
index of 1. Thus, a child ranking in the bottom 
quarter for rejections received an adjustment 
index of 4. A child in the top quarter for accept- 
ance and the bottom quarter for rejection re- 
ceived the highest possible score of 8. In this 
fashion, a social adjustment index, for soc io- 
metric percentile data, was assigned each ofthe 
52 promoted and 51 nonpromoted children for 
whom complete data were available. 

The findings. —The promoted group increased 
its mean score from 4. 42 to 5. 00; the nonpro- 
moted group dropped from 4.94 to 4.71. This 
shift is not emphasized at any particular point 
on the distribution but appears throughout. 
Although 27 promoted children received scores 
of 4 or less on the initial testing, only 18 were 
so rated in May. Meanwhile, the number of non- 
promoted children in these categories changed 
from 21 at the beginning to 24 at the end. Thir- 
teen promoted children compared to 19 nonpro- 
moted children scored 6 or better on the initial 
questioning; 22 of the former and 19 of the latter 
were so rated in May. Of the 52 promoted chil- 
dren, 27 increased their standing, 12 moved 
downward, and 13 remained constant. Of the 
51 in the nonpromoted group, 17 improved, 26 
lost ground, and 8 retained their positions. The 
total picture of change is to the advantage of the 
promoted children. 

Correlating initial and final scores for pro- 
moted children produced a coefficient of . 387. 
Substituting this figure, together with means and 
standard deviations in the regression formula 
produced the equation Y} = .433Y, + 3.08 from 
which nonpromoted scores were predicted. The 
mean of these predicted scores was 5.22 and 
exceeded final attained scores by .513 index 
points. By means of the formula described in 
Section III, the standard error of this difference 
was computed to be .444. Dividing the mean 
difference by its standard error produced acrit- 
ical ratio of 1.16. The difference, then, is sig- 
nificant at about the 25 percent level of confi- 
dence. The hypothesis that there are no differ- 
ences cannot safely be rejected on this evidence. 


An Index of Outwardgoingness 





Computation of the index. —Earlier in this 
section, it was stated that ‘‘the nonpromoted 
children, over the promoted children, tended 
to be selected relatively more often by class- 
mates as being both wanted and not wanted for 
very best friends. ’’ Was this dual trend a sig- 
nificant one ? 
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The answer to the above question was sought 
through the computation of an ‘‘index of outward- 
goingness. '' The quoted statement implies that 
the nonpromoted children ‘‘made contact’’ with 
their peers, for good or bad, more frequently 
than did the promoted group. 

The index of outwardgoingness and the index 
of adjustment were computed ina similar way, 
with one essential difference. Whereas the in- 
dex of adjustment decreased with increase in 
the percentile rating for rejection, the index 
of outwardgoingness increased with increase in 
the percentile rating for rejection. Thus, a 
percentile rating for rejection of 82, which re- 
ceived an adjustment index score of las de- 
scribed in the previous section, receivedanout- 
wardgoingness index score of 4. For accept- 
ance, adjustment and outwardgoingness indices 
were computed alike, a percentile rating of 82 
received a score of 4 in both instances. A child, 
then, rated at or above the seventy-fifth per- 
centile for both acceptance and rejection, re- 
ceived the highest possible index of & for out- 
wardgoingness. 

The findings. —The mean scores for both 
groups declined, dropping from 4.54 to 4. 29 
for the promoted group and from 5.29 to5. 12 
for the nonpromoted. However, different fac- 
tors for each group operated to produce these 
shifts. From the analysis presented earlier in 
this section, it will be recalled that the promot- 
ed group percentile means increased from in- 
itial to final testings for acceptance and de - 
creased for rejection. Nonpromoted group 
percentile means, meanwhile, decreased for 
acceptance and remained constant for rejection. 
The promoted group decline in outwardgoingness, 
then, was the result of decline in the less desir- 
able factor comprising the index; the nonpromot- 
ed group decline was the result of decline in the 
more desirable factor. 

As expected, the decline in mean scores was 
accompanied by a decline by individual children. 
Sixteen of the promoted group increased their 
score, 24 decreased, and 12 remained constant. 
In the case of the nonpromoted group, 17 child- 
ren increased their score, 20 decreased, and 
14 held the same position. 

From the above, it may be seen that, accord- 
ing to the criterion used, both groups declined 
in outwardgoingness. The decline was greater, 
however, for promoted than for nonpromoted 
children. 

Statistical significance of the findings. — 
Once again, the regression technique was used 
to determine the statistical significance of the 
differences indicated. Initial and end scores for 
the promoted group correlated .248. This is an 
exceedingly low coefficient to be used for predic- 
tive purposes; obviously, significance tests made 
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from the use of this coefficient in the equation 
can be only a slight improvement over tests 
made by much simpler methods such as ‘‘t’’- 
test. Substituting this coefficient, together 
with appropriate means and standard deviations 
derived, in the prediction formula produced the 
equation Y} = .227Y, + 3.25, from which final 
scores for each nonpromoted child were pre- 
dicted. Attained scores exceeded predicted 
scores an average of . 651 index points. Divid- 
ing this difference by its standard error of .267 
produced a critical ratio of 2.436. That the 
difference is a true one, then, can be accepted 
at the 1.4 percent level of confidence. The null 
hypothesis that there are no differences between 
the groups on the factor of outwardgoingness, 
as measured by the index, is rejected. 


Mutual Choices and Rejections 





The need to examine mutual bonds. —A single 
bond of acceptance or rejection running fron, 
one child to another represents a different sit- 
uation from that where the bond is reciprocated. 
An analysis of a given child’s mutual bonds of 
acceptance or rejection supplements any analy- 
sis of single bonds in presenting a more com- 
plete picture of social adjustment. According 
to Flotow, ‘‘....the personal influence of a 
member of the class must be measured by the 
number of social choices plus the number of 
mutual relationships and not by social choices 
only. ’’ (17) 

An analysis of mutual choices and rejections 
for the children included in this study might be 
expected to reveal the following trends: 

1. Fewer mutual choice bonds at the begin- 
ning of the year for promoted than for nonpro- 
moted children but an increase for the former 
and a decrease for the latter in tabulations com- 
piled at the end of the year. 

2. Fewer mutual rejection bonds at the be- 
ginning of the year for promoted than for non- 
promoted children, with a decrease for the for- 
mer and little or no change for the latter intab- 
ulations compiled at the end of the year. 

Quantitative analysis of mutual bonds. —The 
analysis of sociometric data revealed that occas- 
ionally a child established more than one mutual 
bond of acceptance or rejection. For the pro- 
moted group at the beginning of the school year, 
13 bonds of mutual acceptance and 5 bonds of 
mutual rejection were shared by 12 and 4 child- 
ren, respectively. For acceptance, 6 of these 
bonds were maintained by boys, 2 by girls, and 
the remaining 5 by boy-girl pairs. For rejec- 
tion, 3 bonds involved boy pairs and 2 were con- 
fined to girls. By the end of the year, the pro- 
moted group had doubled the bonds of mutual 
acceptance, 27 such bonds involving 24 promot- 
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ed children. Six bonds of mutual rejection, 
meanwhile, were shared by 5 promoted young- 
sters. Sixteen of these mutual acceptance bonds 
were maintained by boy pairs, 9 by girls, and 
2 by mixed pairs. 

For the nonpromoted group, the trend was 
quite different. At the beginning of the year, 31 
nonpromoted children shared 41 mutual accept- 
ance bonds; 22 were boy pairs, 17 girls, and 2 
were mixed. Twelve bonds of mutual rejection 
were shared by 11 nonpromoted children, 5 
bonds involved only boys, 3 involved girls and 
4 both boys and girls. By the end of the year, 
only 31 mutual acceptance bonds were main- 
tained, made up of 16 pairs of boys, 12 of girls, 
and 3 of mixed sexes. Eighteen nonpromoted 
children were involved. The rejection picture, 
however, showed little change, 13 bonds being 
maintained by 12 nonpromoted children, 9 of boys, 
1 of girls, and 3 of both sexes. 

These results largely uphold the assumptions 
put forward at the end of the preceding section. 
More nonpromoted than promoted children (31 
to 12) were involved in bonds of mutual choice 
at the beginning of the year, a finding that is 
significant at better than the 0.1 percent level. 
More promoted than nonpromoted children (24 
to 18) established mutual acceptance bonds at 
the end of the year; this difference is reliable 
at about the 24 percent level of confidence. Ob- 
viously, the trend is a significant one favoring 
the promoted group. The picture of mutual re- 
jection changed but little for both groups, each 
having one more bond at the end of the year than 
at the beginning and the nonpromoted group es- 
tablishing more on both occasions. 

One other difference in group patterns war- 
rants attention. On both trials, the ratio of mu- 
tual choices to children sharing those choices 
was closer to 1 for the promoted than for the non- 
promoted group; that is, fewer promoted than 
nonpromoted children tended to be involved in 
more than one mutual acceptance bond. Further- 
more, the decline in mutual relationships for 
the nonpromoted group was markedly greater 
when measured by number of children involved 
than by number of acceptance bonds established, 
The ratio of bonds to children for the nonpro- 
moted group was greater at the end of the year 
than at the beginning. 

Qualitative analysis of mutual bonds. —The 
problem arose as to whether or not one group, 
more than the other, tended to be involved in 
mutual bonds with children who were accepted 
or rejected a disproportionate share of the time. 
Therefore, percentage and percentile data for 
both acceptance and rejection for all children 
involved in mutual bonds with the promotedand 
nonpromoted children were tabulated. 

The trends were very similar for bothgroups. 
The children with whom the promoted and non- 
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promoted children maintained mutual bonds of 
acceptance at the end of the year were accepted 
more and rejected less than were those with 
whom such bonds were maintained at the begin- 
ning of the year. A Similar situation prevailed 
in regard to mutual rejection bonds when the 
data were computed in percentages. For per- 
centile data, however, the children at the other 
end of the rejection bonds in May were both ac- 
cepted and rejected less than were those in- 
volved in October. Such differences as were 
present between promoted and nonpromoted 
groups in regard to the acceptance and rejec- 
tion pictures of those children with whom they 
established mutual bonds were not significantat 
any of the conventionally accepted levels. 

One other question that arose was whether 
or not nonpromoted children tended to seek out 
one another as mutual friends to a greater de- 
gree at the beginning than at the end of the year. 
Similar information was not sought for the pro- 
moted children, since there was no way of ident- 
ifying other children of like progress intheir 
rooms. A check revealed that, of the 41 mutu- 
al acceptance bonds established by nonpromoted 
children at the beginning of the year, 18 were 
with other nonpromoted children. At the end of 
the year, however, only 8 of the 31 mutual ac- 
ceptance bonds involved pairs of nonpromoted 
children. To be accurate, the significance of 
this difference should be tested using the tech- 
nique for comparing correlated proportions, 
since the sample of cases involved is the same 
for both trials. However, the amount of cor- 
relation being unknown, the technique for uncor- 
related percentages was used and a confidence 
level of 9.8 percent obtained. Allowing for the 
factor of correlation, therefore, probably would 
raise the level of confidence to better than 9 per- 
cent. Only 2 bonds of mutual rejections involved 
nonpromoted pairs at the beginning of the year ; 
there was none at the end of the year. 


Summar 


The foregoing analysis of sociometric data 
revealed the following statistically significant 
trends from initial to final ratings: 


1. The promoted children were named less 
frequently than the nonpromoted childrenas per- 
sons not desired for very best friends (2. 4 per- 
cent when computed in percentile form and7.4 
percent when computed in percentages). 

2. Greater social ‘‘outwardgoingness’’ for 
the nonpromoted group (1. 4 percent), outward- 
goingness being computed from a percentile in- 
dex combining both social acceptance and social 
rejection. 

3. More mutual acceptance bonds for non- 
promoted children at the beginning of the year 
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(0.1 percent); more mutual acceptance bonds 
for promotedchildrenat the end of the year (23.8 
percent). 

4. A tendency for the nonpromoted children 
to seek out one antoher as mutual friends more 
often at the beginning than at the end of the year. 
(This difference was significant at only the 9.8 
percent level, using the technique for compar- 
ing uncorrelated percentages, but should be ad- 
justed upwards to take into account the correla- 
tion factor. ) 


SECTION V 


ANALYSIS OF THE TEACHER-RATING DATA 


Introductory 


This section compares the promoted and 
nonpromoted children on certain aspects of their 
development as appraised by their teachers on 
the Haggerty-Olson-Wickman Behavior Rating 
Schedules. Only those aspects of the scales pur- 
porting to estimate behavioral characteristics, 
and social and emotional development were used. 
These inventories, unlike the self-rating and 
peer-rating devices, were used only once— 
during the last few weeks of the school year. 


Teacher-Rating Findings 


Behavior. Schedule A of the Haggerty-Olson- 
Wickman Schedules consists of fifteen be havior 
problems. The problems are weighted both for 
frequency of occurrence and for seriousness to 
the individual as judged hy teachers. The weight- 
ing is such that high and low scores indicate un- 
desirability and desirability of behavior, respec- 
tively. 

The scores on Schedule A for the promoted 
and nonpromoted groups are presented in Table 
II (see page 305). Meanscores of 26.0 for promot- 
edchildrenand 32.0 for nonpromoted c hildren 
aretothe advantage of the former. 

Social and emotional. —Schedule B is com- 
posed of thirty-five traits weighted according to 
their relationship to the overt behavior problems 
of Schedule A. Only two of the four sections 
comprising Schedule B were used, the sections 
on social and emotional adjustment. As for 
Schedule A, high scores indicate the presence 
of many problems, serious problems, or both. 

Table I represents the distribution of both 
groups on the total for Division II], Social, and | 
Division IV, Emotional, of Schedule B. The 
lower mean score of 46.6 for the nonpromoted | 
group, as contrasted to that of 47.4 for the pro- | 
moted group, is slightly in favor of the former. | 


Table IV compares the two groups onthese two 
divisions taken separately. 
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The promoted group, with a mean of 24. Ton 
Division I] and a mean of 22.5 on Division IV, 
compared with means of 23.7 and 22.9 for the 
nonpromoted group, has a slight edge inrespect 
to emotional development but shows up less well 
on the social side. 


Statistical Significance of the Findings 





The technique. —Analysis of data collected 
from utilization of the Haggerty-Olson-W ick - 
man Behavior Rating Schedules presented a 
slightly different problem from that presented 
by the self- and peer-rating data. In this in- 
stance, only end scores were obtained. Simple 

omparison of differences between means was 

ot a satisfactory procedure since it did not take 
into account any initial differences that may have 
been present at the beginning of the year. The 
closest estimate of these initial differences that 
could be made was the performance of the two 
groups on some other criterion of adjustment. 
The higher the correlation between Hagg erty- 
Olson-Wickman scores and initial scores onthe 
selected criterion, the more satisfactory this 
criterion would be as a yardstick for estimating 
the significance of group differences in the for- 
mer. Consequently, the performances of the 
promoted children on Schedule A, Divisions Hl 
and IV of Schedule B, and the total of Divisions 
Ill and IV, were correlated with their perform- 
ance on all other evaluative criteria used. In 
all instances, promoted children’s Haggerty- 
Olson-Wickman scores correlated more highly 
with their initial scores for sociometric rejec- 
tion (computed in raw percentages) than withany 
other single criterion. The four coefficients 
ranged from .537 to .567. These coefficients 
were then used in the equation, described in the 
two preceding sections, to determine the regres- 
sion of promoted group Behavior Rating Scale 
scores upon promoted group initial sociometric 
rejection (raw percentage) scores. Haggerty- 
Olson-Wickman scores for nonpromoted child- 
ren were predicted from the regression equa- 
tion on the basis of their initial sociometric re- 
jection scores. Predicted and attained scores 
were then compared and the significance of mean 
differences tested as previously described. 

Schedule A scores. —Schedule A theoretical 
scores for nonpromoted children were predicted 
from the formula Y} = 1.28Y, + 17.11. Attained 
scores exceeded predicted scores by the mean 
difference of 4.39. This excess was to the ad- 
vantage of the promoted group, since high 
scores are indicative of undesirable behavior. 
The mean difference, divided by its standard 
error of 4.35, produced a critical ratio of 1.01. 
From the table, the probability of obtaining a 
deviate greater than this value in either direc- 
tion is .312. The null hypothesis that thereare 
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TABLE Ill 


THE HAGGERTY-OLSON-WICKMAN BEHAVIOR RATING SCHEDULES 
TOTAL FOR SOCIAL AND EMOTIONAL DIVISIONS OF 
SCHEDULE B 





Range Promoted Group Nonpromoted Group 





. 5-89. 
. 5-84. 
. 5-79. 
. 5-74. 
. 5-69. 
. 5-64, 
. 5-59. 
. 5-54. 
. 5-49. 
. 5-44. 
. 5-39. 
. 5-34. 
. 5-29. 
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THE HAGGERTY-OLSON-WICKMAN BEHAVIOR RATING SCHEDULES 
SOCIAL AND EMOTIONAL DIVISIONS OF SCHEDULE B 
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no differences cannot be rejected on this evi- 
dence, 

Schedule B scores. —Nonpromoted group 
scores on the total for Division Il and IV of 
Schedule B were predicted from the formula Y}= 
.7T4Y, + 42.29. Attained scores fell short of 
predicted scores an average of 541 per child. 
The standard error of this difference was 2.078 
which divided into the mean difference . 260 
times. The probability of obtaining a deviate 
greater than this value is .794. The null hypoth- 
esis that there are no differences is retained. 

Theoretical scores on Division III (Social) 
for the nonpromoted group were predictedfrom 
the formula Y} = .38Y, + 22.05. Again, pre- 
dicted scores exceeded attained scores, this 
time by a mean difference of 1.54. This differ- 
ence divided by 1.14, its standard error, pro- 
duced a critical ratio of 1.350. This figure 
represents a Statistically significant difference 
of 17.6 percent, a level of significance not con- 
ventionally accepted as reliable. 

Nonpromoted group theoretical scores for 
Division IV (Emotional) were predicted from the 
formula Y} = .43Y, + 19.51. This time, attained 
scores exceeded predicted scores .637 points 
per child, on the average. The standard error 
of this difference was computed to be 1.24. The 
mean difference divided by its standard er- 
ror produced a critical ratio of .514. The prob- 
ability of obtaining a deviate greater than this 
value in either direction is .610. This evidence, 
by itself, is not sufficiently conclusive for re- 
jection of the null hypothesis that there are no 
differences between the groups. 


Analysis of Items 





Purpose of the analysis. —The distribution 
of groups on each item was analyzed inorder 
to: 

1. Identify those single items that discrim- 
inated between promoted and nonpromoted 
groups. 

2. Identify any patterns of group difference 
Suggested by combinations of such items. 

3. Suggest possible leads for further explor- 
ation into the subject under investigation. 

Four items were isolated as offering great- 
est promise for revealing significant differences 
between the two groups. These were: disinter- 
est in school work (item 1), cheating (item 2), 
unpopular with children (item 7), and bullying 
(item 9). Items 1, with nonpromoted to 24 pro- 
moted children in the category of less frequent 
occurrence, and 2, with 46 nonpromoted to 40 
promoted children thus rated, suggested a great- 
er tendency towards disinterest in school work 
and cheating on the part of the promoted group. 
Items 7 and 9, with only 31 nonpromoted to 46 
promoted and 49 nonpromoted to 54 promoted 
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children in the categories indicating less fre- 
quent occurrence, suggested a greater tendency 
on the part of nonpromoted children towards un- 
popularity with children and bullying. It is of 
interest to note that the two categories, disin- 
terest in school work and cheating, bear a re- 
lationship to one another, as do bullying and un- 
popularity with children. 

To determine the amount of confidence to be 
placed in the above differences, the technique 
used to test the statistical significance of the 
difference between two uncorrelated percent- 
ages was applied. The number of individuals 
falling into each category was replaced in each 
case by the percentage so rated and the differ- 
ences were tested. The tendencies of the non- 
promoted children to bully and to be unpopular 
with children proved most significant, testing 
at the 4.6 and 0.2 percent levels of statistical 
confidence, respectively. The two next most 
significant items—the tendencies of the pro- 
moted group to cheat more and to be less inter- 
ested in their studies—tested at only the 16.2 
and 17.6 percent levels of statistical signifi- 
cance. There was no need, therefore, to ex- 
amine other items, all of which discriminated 
between the groups to an even lesser degree 
than did ‘‘disinterested in school work’’ and 
‘‘cheating. ’’ 

As both a check on the foregoing and an en- 
deavor to discover other discriminating items, 
certain rating categories once more were arb- 
itrarily combined. It seemed significant to dis- 
tinguish, for any given item, between the num- 
ber of children in each group rated ‘‘has never 
occurred’’ and the number rated for any inci- 
dence of occurrence, whether once or twice, 
occasionally, or frequently. Therefore, the 
children rated in the first category were treat- 
ed as one group, and those rated in the other 
three categories as another. Six items thus 
were isolated and the significance of group dif- 
ferences was tested. 

This time, the tendency of the promoted 
group tocheat (item 2) was significant at the 
1.0 percent level. The other items showed 
greater tendency for the nonpromoted children 
to be defiant to discipline (item 5), unpopular 
with children (item 7), reveal temper outbursts 
(item 8), bully (item 9), and steal (item 13). 
However, only items 7 and 13 were significant 
at better than the 5 percent level. The tendency 
for the nonpromoted group to be more unpopu- 
lar with other children stands out as the most 
significant difference revealed by the item an- 
alysis of Schedule A. This difference has a 
0.2 percent probability when analyzed one way 
and 1.8 percent when analyzed another. 

Analysis of Schedule B items. —The analysis 
of group distributions of Schedule B items offer- 
ed an even moré complex problem, since each 
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child was rated according to a weighted, five- 
point scale. This weighting system was consid- 
ered too refined for the purposes at hand. Close 
examination of the descriptive categories under 
each weighting revealed an attempt on the part 
of the scale-makers to depict a continuum of be- 
havior, ranging from one extreme through a 
central tendency to another extreme. Examin- 
ing item 15, for example, ‘‘Is he quiet or talk- 
ative?’’, revealed that it called for a rating re- 
sponse ranging from ‘‘speaks very rarely’’ at 
one extreme to‘‘jabbers’’ atthe other. It seemed 
logical, therefore, to group ‘‘speaks very rare- 
ly’’ and ‘‘usually quiet’’ into one category de- 
scriptive of individuals who tend to be quiet, and 
to group ‘‘jabbers’’ and ‘‘talks more than his 
share’’ into another descriptive of persons who 
tend to be talkative. Such procedure focused 
attention on the descriptive phrases and elimin- 
ated completely all weighting considerations. 

The writer went through items 15 to 35inthis 
way, arbitrarily reducing five categories to 
three. The list of items was examined to ident- 
ify those items that appeared to differentiate 
significantly between the groups. Eight trial 
items were isolated in this fashion. More pro- 
moted than nonpromoted children were rated as 
being ‘‘inwardgoing,’’ gracious, and yielding. 
More nonpromoted than promoted children were 
rated as being talkative, resigned and compliant, 
stolid, easily discouraged and cautious. How- 
ever, in some instances these differences tend- 
ed to be offset by a reversal of the situation ex- 
pected at the other extreme. For example, al- 
though more promoted than nonpromoted child- 
ren were rated ‘‘inwardgoing’’ in their social 
habits, more of the former than of the latter al- 
so were rated as being ‘‘outwardgoing. ’’ Rever- 
sals of this sort put a reservation on statements 
such as ‘‘the nonpromoted children tended to be 
more inwardgoing socially, a difference accept- 
ed at the 1 percent level of statistical confidence,’’ 
a reservation that was taken into consideration 
in the final interpretation of findings. 

The results enumerated above were convert- 
ed into percentages and the standard error of 
the difference between uncorrelated percentages, 
critical ratios, and probabilities were computed. 
Only the tendency of promoted children to be rat- 
ed more inwardgoing in their social habits (item 
17) showed up as a difference that could be ac- 
cepted with a high level of confidence (0. 6 per- 
cent, reduced somewhat by a tendency also for 
promoted children to be rated more frequently 
as outwardgoing). The tendency for nonpromot- 
ed children to be more resigned in their accept- 
ance of authority (5.6 percent), to be more stol- 
id in temperament (7. 6 percent) and to act more 
cautiously (8.2 percent), were the other differ- 
ences that most closely approximated levels of 
statistical confidence conventionally acceptedas 
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reliable. 


Summar 


No statistically significant differences be- 
tween the promoted and nonpromoted groups for 
the Haggerty-Olson-Wickman Behavior Rating 
Schedules were found when total scores for any 
given schedule or subsection were considered. 
However, certain individual items on bothSched- 
ules A and B discriminated significantly between 
the groups. For Schedule A, these were as fol- 
lows: 


Item 2: Cheating. Thirty-seven nonpromot- 
ed as against 24 promoted children were rated 
‘thas never occurred’’ (1. 0 percent). 

Item 7: Unpopular with children. Forty-six 
promoted as against 31 nonpromoted children 
were rated ‘‘has never occurred”’ or ‘‘has oc~ 
curred once or twice’’ (0.2 percent). Thirty 
promoted to 17 nonpromoted children were rat- 
ed ‘‘has never occurred”’ (1.8 percent). 

Item 9: Bullying. Fifty-four promoted to 49 
nonpromoted children were rated ‘‘has never 
occurred’’ (4.6 percent). 

Item 13: Stealing. Fifty-four promoted to 
47 nonpromoted children rated ‘‘has never oc- 
curred’’ (1.2 percent). 

For Schedule B, only item 17, ‘‘What are his 
social habits?’’, revealed differences that are 
acceptable at conventional significance levels. 
More promoted than nonpromoted children (26 
to 13) were rated ‘‘lives almost entirely to him- 
self’’ or ‘‘follows few social activities’’ (0.6 
percent). However, this difference must be in- 
terpreted in the light of the fact that 10 promot- 
ed to 6 nonpromoted children were rated ‘‘ac- 
tively seeks social pleasures”’ or ‘‘prefers so- 
cial activities to all else’’ on this item. 


SECTION VI 


SYNTHESIS AND INTERPRETATION 
OF FINDINGS 


Purpose of this Section 





The present section is designed to bring to- 
gether differences between groups that have 
been identified, to combine related differences 
into appropriate patterns, and to interpret the 
meaning and significance of these patterns. 

First, an index of total adjustment was 
worked out to show both the consistency of 
individual scores and the total difference be - 
tween groups on all instruments. Two ques- 
tions were thus answered: 

1. Did the same promoted or nonpromoted 
children tend to score consistently low on all 
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instruments, or did they balance theirlow 
scores on one instrument with high ones on 
another ? 

2. Did the pooling of all total scores oneach 
instrument reveal significant differences be- 
tween the groups ? 

Then, a number of hypotheses were put for- 
ward to explain the presence of significant dif- 
ferences in the light of the promotion factors. 


An Index of Total Adjustment 





Computation of the index. —The 52 promoted 
and 51 nonpromoted children for whom all data, 
both initial and final, were available were com- 
bined into one group of 103 children.* Single 
distributions were then prepared to show the 
scores of these children on each trial of the 
three instruments used. Promoted and nonpro- 
moted children no longer were differentiated; 
Single distributions sufficed for both. Quartiles 
for each of these distributions were then com- 
puted. 

The next step in the computation of the total 
adjustment index was the computation of an in- 
dex score for each child on each phase of adjust- 
ment measured. This was done by means of a 
four-point scale based on the four quarters of 
any given distribution. To illustrate, scores of 
33 or more on Self-Adjustment, initial trial, 
were in the top quarter of the total distribution, 
scores of 31 to 32 in the second quarter, scores 
of 27 to 30 in the third, and scores of 26 or less 
in the fourth. Since high scores on the Californ- 
ia Test are deemed desirable scores, those in 
the top quarter were assigned an index of 4, 
those in the second quarter an index of 3, and 
soon. Adjustment indices were computed in 
Similar fashion for Social Adjustment, and so- 
ciometric acceptance. High scores for socio- 
metric rejection and for the Haggerty-Olson- 
Wickman Scales are deemed undesirable scores. 
Consequently, the method of assigning indices 
here was reversed so that the bottom quarter re- 
ceived the high score of 4, the third quarter re- 
ceived 3, the second 2, and the top quarter 
was assigned an index of 1. 

By means of the quartile ranks, indices were 
assigned each child for initial trials on the Self- 
and Social-Adjustment phases of the California 
Test of Personality and both sociometric accept- 
ance and sociometric rejection. The maximum 
and minimum possible scores for the total in- 
itial testing were, therefore, 16 and 4 respec- 
tively. For the final testing, indices for the 
same instruments, together with indices for Di- 
visions III and IV of the Haggerty-Olson-Wickman 
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Scales, were computed. Maximum and mini- 
mum scores for the final testings, therefore, 
were 24 and 6. Total adjustment index scores 
ranged from 4 to 16 for the initial trial and 
from 6 to 24 for the end trial. 

Total index scores for each child having 
been allotted in the manner described avove, 
promoted and nonpromoted children were then 
assigned to separate distributions. The mean 
initial index score of 9.58 for promoted child- 
ren was Slightly less than the mean of 10.0 for 
nonpromoted children but, on the finaltrial, 
the promoted group mean of 15.5 exceeded the 
nonpromoted group mean of 14.8. This shift 
from initial to end mean scores favored the pro- 
moted group. Was the difference between the 
groups a significant one? 

Statistical significance of total adjustment 
findings. —~To determine whether or not the dif- 
ferences revealed between the groups could be 
accounted for by chance alone, the regression 
technique was used to determine the statistical 
significance of these differences. Correlating 
initial and end total index scores for promoted 
children produced a product-moment correla- 
tion of .574. Substituting this figure, together 
with the necessary data in the regressionform- 
ula, produced the equation Y} = . 723Y, + 8.57 
from which a total index score for each nonpro- 
moted child was predicted. Attained fell short 
of predicted scores by the mean difference of 
1.04. The standard error of this difference was 
.660; the mean difference divided by its stand- 
ard error produced a critical ratio of 1.58. The 
probability of attaining a difference greater than 
this in both directions is .115. The difference, 
favoring the promoted group, can be accepted 
at only the 11.5 percent level of confidence. 
The null hypothesis that there are no differences 
cannot safely be refuted on this evidence. 

Consistency in individual scores. Another 
question raised was whether or not certain child- 
ren tended to have consistently low or highadjust- 
ment index scores. There was no discernible 
tendency for the scores of certain individuals to 
be consistently in either the top or bottom quar- 
ters of all distributions. 








Interpretation of Findings 


Interpretation of major findings. —Major dif- 
ferences were examined first in order to identify 
any patterns into which differences on individual 
items might be woven. It will be recalled that 
significant major group differences occurred only 
on sociometric data. These were as follows: 











#It will be recalled from Section IV that sociometric data for 52 promoted and 51 nonpromted children 
were available. 
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1. The promoted children were rejected sig- 
nificantly less by classmates as persons not de- 
sired for very best friends. 

2. Nonpromoted children were more outward- 
going; that is, they tended to be both accepted 
and rejected as very best friends more thanpro- 
moted children when acceptance and rejection 
were considered simultaneously as one score. 

3. Promoted children increased, while non- 
promoted children decreased, their bonds of mu- 
tual acceptance. 

4. Nonpromoted children tended to recipro- 
cate one another’s choices to a greater degree 
at the beginning than at the end of the year. (This 
shift was significant at only the 9 percent level, 
uncorrected for correlation, but is included here 
as an aid in understanding the general pattern. ) 


The whole picture of sociometric change 
over the school year was one of decline in de - 
sirable adjustment for the nonpromoted child- 
ren and of improvement for promoted children. 
These repeating youngsters were oldtimers com- 
pared to the incoming first-graders with whom 
they associated. They ‘‘knew the ropes’’ and, 
perhaps because of this fact, assumed positions 
of prominence at the outset. A good many ofthe 
newcomers sought out these older classmates 
for friends; or, at least they expressed a desire 
to associate with the repeaters. At the same 
time, however, others among the incoming group 
disliked many of the nonpromoted children; per- 
haps they had experienced or were experiencing 
bullying from the latter. Meanwhile, nonpro- 
moted children tended to seek out one another, 
setting up little cliques within the larger group. 
The fact that nonpromoted.children conceatrated 
their best-friend choices among themselves ia- 
stead of distributing them more proportionately 
throughout the room is a potent factor to be con- 
sidered in interpreting the large number of 
choices received by this group at the beginning 
of the year. 

At the end of the year, the nonpromoted child- 
ren still maintained, on the whole, relatively 
prominent positions in their classrooms, but 
their prominence was founded on a different bas- 
is. While they had not declined in unpopularity 
as measured by rejection, they had declined in 
popularity as measured by acceptance. Nothing 
in the data suggested that these nonpromoted 
children sought less desirable individuals for mu- 
tual friends than they had at the beginning of the 
year; at any rate, their mutual acceptance bonds 
were maintained with relatively popular child- 
ren on both trials. 

By the end of the year, the promoted child- 
ren had greatly strengthened their positions in 
the social structure of the classroom. Although 
they were less outwardgoing, as measured by 
the index, this change had come about by a re~- 
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duction in rejection that exceeded an increase 

in acceptance. Accompanying the increase in 
social acceptance as measured by single bonds 
of choice, was an increase in the number of mu- 
tual bonds established. The whole comparative 
picture of change was one of increasing health- 
iness in social adjustment for the promoted 
group, 

Interpretation of items related to social ad- 
justment. —Differences in single items relatec 
to social adjustment were consideredfirst, since 
all major differences identified were concen- 
trated in this area. 

The writer sought, through examination of 
the discriminating items, to discover, first, 
evidence to explain why the nonpromoted group 
declined in acceptance and why it maintaineda 
higher level of rejection than was maintained by 
the promoted group. The following evidence 
threw considerable light on the problem: 





1. The nonpromoted children appeared to be 
lacking in certain social skills requisite to am- 
icable group relationships. They declined, while 
the promoted group improved significantly, on 
the self-rated items, ‘‘Do you tell mean child- 
ren what you think of them ?’’ and ‘‘Do many of 
the children start quarrels with you?’’ Of course 
these questions are disguised to make it appear 
that the other children are at fault. Theanswers, 
however, reveal an excess of involvement in 
friction-producing relationships with other child- 
ren, relationships tending to incur ill-will and 
subsequent rejection as friends. Related here, 
also, is the significant nonpromoted group de- 
cline on the item, ‘‘Do people try to argue with 
you a great deal?’’ There was, however, a 
slight decline for promoted children as well on 
this item. 

Appropriate to this discussion of social skills, 
is the fact that nonpromoted children were rated 
by their teachers significantly more than pro- 
moted children for bullying. The possibility 
that first-graders experienced bullying from 
these older repeaters was put forward earlier 
as a factor to be considered in explaining the 
rejection of nonpromoted children. There ap- 
pears to be ample evidence to support the pos- 
sibility that inadequacy in the area of social 
skills contributed to less satisfactory social ad- 
justment on the part of the nonpromoted group. 

2. Another hypothesis is that undesirable so- 
cial standards or attitudes contributed to the de- 
clining social adjustment of the nonpromoted 
group. Supporting evidence is found in the fact 
that there was an increasing tendency for the 
promoted group and a decreasing tendency for 
the nonpromoted group to answer ‘‘no’’ to the 
question, ‘‘Should one be nicer to bright child- 
ren than to others?’’ In addition, while there 
was no Change for the nonpromoted group onthe 
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item, ‘‘Should a person always be nice to those 
who win from him in games?’’ the promoted 
group answered ‘‘yes’’ significantly more often 
on the final than on the initial trial. These dif- 
ferences suggest a greater predisposition onthe 
part of the promoted children to behave socially 
in a more approved manner. Inadequacy of the 
nonpromoted group in the areas of social skills 
and social standards most certainly would ex- 
plain why these children were rated more fre - 
quently by their teachers as being unpopular with 
children. 

3. There is evidence from test material pur- 
porting to measure both social and self-adjust- 
ment to support the exploratory hypothesis that 
the nonpromoted children, more than the pro- 
moted children, both sensed and experienced 
the disapproval of their peers. The promoted 
children improved and the nonpromoted children 
declined on the following items of the California 
Test of Personality included under social adjust- 
ment subsections: 

a. ‘‘Do many people you know say mean 

things about you?’’ 

b. ‘*Do you classmates often say things that 
hurt your feelings?’’ 

c. ‘*Do you think that most of the children in 
your school are trying to keep you away 
from them?”’ 

It would be interesting to know if other per- 
sons really said mean things to hurt the feelings 
of these repeaters and, if so, the nature of the 
things said. Might they be, for example, ‘‘dumb’’ 
or ‘‘stupid’’ for having to repeat the grade? 

In addition to the above, responses to the 
question, ‘‘Do you think other children do not 
like you?’’, listed under Self-Adjustment on the 
California Test, favored the promoted group. 
Group differences on the above four items seem 
to indicate that the nonpromoted children, more 
than the promoted children, both sensed inward- 
ly and experienced outwardly the dislike of mem- 
bers of their peer group. 

4. The group sociometric data suggested 
greater outwardgoingness for nonpromoted than 
for promoted children. It must be remembered, 
however, that sociometric rejection contributed 
more to this situation than did sociometric ac- 
ceptance. The teacher-rating data contributed 
supporting evidence; more promoted than non- 
promoted children were rated as following few 
social activities. 

Evidence here, all under the Self-Adjustment 
division of the California Test of Personality, is 
conflicting. Differences on the following items 
favored the nonpromoted group: 

a. ‘‘Do the children ask you to play withthem ?’’ 

b. ‘‘Do the other children like to have you 
with them ?’’ 

Once again, these data indicate only how the 

children felt about themselves. Whether or not 
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the situation suggested here was reciprocated 
by the other children is not known. Perhaps the 
responses to these questions are indicative only 
of ‘‘wishful thinking, ’’ an expressed desire to 

be wanted by the other children made more poig- 
nant by the realization that their classmates 
said mean things about them, hurt their feelings, 
and tried to avoid them. The possibility that 
some wishful thinking may have been involved 
here is strengthened by other Self-Adjustment 
differences related to outwardgoingness that 
favored the promoted group. There wasa great- 
er tendency for the promoted group to answer 
**no’’ to the following questions, answers that 
are indicative of greater freedom from with- 
drawing tendencies: 

a. ‘*Do you like to stay away from many of 

the children?’’ 

b. ‘‘Would you rather think about nice things 

than play?’’ 

The bulk of the evidence supports the hypoth- 
esis that the nonpromoted group engaged more 
actively in social activities. However, other 
evidence has shown that their social contacts 
provoked friction and incurred dislike. Perhaps 
it was feelings of personal dissatisfaction with 
this undesirable and disapproved socialization 
that stimulated the desires to ‘‘think about nice 
things’’ and to ‘‘stay away from many of the chil- 
dren. ’’ Much of the preceding evidence indicates 
somewhat ‘‘stormy’’ peer-group relationships 
for the nonpromoted group. Such relationships 
need not be detrimental to development of the in- 
dividual personality. However, when they are 
accompanied, as they are here, by undesirable 
growth in social skills and attitudes and by ex- 
pressed desires to withdraw from peer-group 
social experiences, their value to the individual 
is in serious doubt. 

Interpretation of items related to self-adjust- 
ment. —It will be recalled that there were no 
significant differences between the groups for 
total scores on any instrument or on any sub- 
section of instruments purporting to measure 
personal adjustment. There were, therefore, 
no suggestions of major trends around which sig- 
nificant findings for single items could be grouped. 
It was necessary, then, to develop any existing 
patterns of group differences from combinations 
of discriminating items. The patterns thus ident- 
ified are described below: 





1. The promoted children revealed indications 
of being disturbed over their school progress. 
First, they were rated by their teachers for cheat- 
ing significantly more than were the nonpromoted 
children. Furthermore, while the nonpromoted 
group declined only slightly on the self-rated item, 
‘‘Are you often unhappy because of getting low 
marks in school?’’, the promoted group declined 
significantly on this question. These data suggest 
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that many of these promoted youngsters, slow- 
learners during their first year of formalschool- 
ing, were taxed beyond their learning capacity 
by the work of the second grade. Unfortunate- 
ly, because of the gross overcrowding of many 
elementary classrooms, the rigidity of grading 
policy, curriculum, and instruction, and the 
tendency for many teachers to think of them- 
selves as teachers of given grades rather than 
of children, our schools often give little more 
than lip-service to individualized instruction. 
To the degree that these and like conditions ex- 
isted in the schools of the present study, these 
schools probably were unable to adapt their in- 
structional programs to the needs of these slow- 
learning children. It is not surprising, then, 
that some youngsters resorted to cheating as 
one means of conforming to expected levels of 
achievement. More disturbing is the fact that 
they were ‘‘unhappy because of getting low 
marks in school. *’ 

2. Two other differences that seemed closely 
related to the preceding discussion favored the 
nonpromoted group. Both groups declinedfrom 
initial to end trials on the items, ‘‘Do your par- 
ents criticize you a lot but seldom praise you?’’ 
and ‘‘Do you feel that no one loves you at home?”’ 
The decline for the nonpromoted group was only 
Slight but that for the promoted group was sig- 
nificant. The greater unhappiness over low 
marks and feelings of being unwanted at home 
for the promoted children appear to be related. 

Practically all parents are concerned over 
the school success of their children; the pres- 
tige of the entire family is involved. The com- 
parative progress of these second-graders prob- 
ably was not up to parental expectations; reports 
to the home may not have been of a sort toelicit 
praise. Slow progress and teacher-comments 
to the effect that ‘‘Henry will have to do better 
if he is to make the grade, ’’ frequently go hand- 
in-hand. Parent and teacher exhortations to do 
better when the capacity to do better was not 
there seem well directed to the end of creating 
feelings of both unhappiness at school and re- 
jection at home. 

The question arose as to why these tendencies 
were not so clearly developed in the nonpromot- 
ed group. It may have been because, after both 
parent and child had experienced a failure, con- 
tinued slow progress could be only anti-climatic. 
Or, it may have been because the greater ease 
in achieving on a second trial mitigated against 
friction-producing situations and so reduced 
tensions all around, for child, teacher, and 
parent. Then, too, an actual grade failure fre- 
quently precipitates teacher-parent conferences. 
Such conferences often center around the theme 
that ‘‘another year in the grade will be better for 
Henry in the longrun, ’’ a possibility that a con- 
scientious parent usually is willing to accept. 
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The parent even may readjust, secretly, his 
ambitions and content himself in the future with 
a much lower expectancy for Henry. 

3. A number of statistically significant itens 
supposedly related to self adjustment but not 
clearly enough related to the preceding analysis 
or to one another to be woven into a meaningful 
pattern are discussed below. 

a) The nonpromoted group declined signifi- 
cantly and the promoted group declined 
only slightly on the item, ‘‘Is it hard to 
talk things over with your folks because 
they don’t understand?’’ This result ap- 
pears to contradict the earlier findings 
related to the home situation. Was the 
increased tendency for nonpromoted chil- 
dren to answer ‘‘yes’’ to this question the 
result of decreased parental interest in 
these children because of disappointment 
in them? Such an outcome seems to be 
out of all proportion to the magnitude of 
the suggested stimulus. 

b) The promoted group improved significant- 
ly and the nonpromoted group declined 
markedly on the item, ‘‘Do you have many 
colds?’’, an item purporting to measure 
freedom from nervous symptoms. There 
was no additional evidence in this area up- 
on which to base interpretations. How- 
ever, there may be a connection here with 
the social adjustment evidence listed eari- 
ier to the effect that the nonpromoted chil- 
dren appeared to sense the disapproval of 
their peers. Affirmative responses to 
this particular item certainly could be con- 
nected with a basic sense of insecurity. 

c) The nonpromoted group gained significant- 
ly and the promoted group gained only 
slightly on the item, ‘‘Do the children 
think you are afraid of things?’’ These 
findings make sense in the light of prev- 
ious findings and the actual wording of the 
question. If the question had been worded 
‘‘Are you afraid of things?’’, it might have 
constituted a rather obvious attempt to get 
at nervous symptoms; the question in this 
area on colds is much more subtle. It is 
to be expected that the repeaters would re- 
act as they did to this question. Inthefirst 
place, they were older and thus probably 
more daring than their classmates, In the 
second place, realizing their possibilities 
for superiority in physical prowess as con- 
trasted with their demonstrated inferior- 
ity in mental activities, they could not af- 
ford to give the other children cause to 
think them afraid. This finding and the 
assumptions raised about it suggest a re- 
lationship to greater tendency towards bul- 
lying reported for the nonpromted group. 

d) The final significant difference between 
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the groups was that the nonpromoted chilc- 
ren were rated by their teachers more 
frequently for stealing. None of those 
checked for this offense was rated in a 
category of frequency higher than ‘‘occas~- 
ional occurrence.’’ Furthermore, no ev- 
idence was available concerning the nature 
of the transgressions themselves. Crim- 
inologists generally attribute a chronic 
disposition to thievery to the presence of 

a combination of several debilitating fac- 
tors. Many case studies suggest bothcar- 
eers of theft and single instances of theft 
as means of seeking a revenge against a 
discriminating or misunderstanding society. 
A possible interpretation of the greater in- 
cidence of stealing for nonpromoted child- 
ren is suggested in the light of this theory 
and the less satisfactory social adjustment 
of the nonpromoted group. 


The preceding discussion has served to point 
out some trends or patterns of differences be- 
tween the promoted and nonpromoted groups and 
to offer some explanation for the presence of 
these patterns. Most of the differences favored 
the promoted group, suggesting the superiority 
of promotion over nonpromotion in the areas 
evaluated, a consideration that is discussed 
more fully in the next section. 


SECTION VU 


CONCLUSIONS AND RECOMMENDATIONS 
, 
Conclusions 


In the initial section, it was stated that the 
following hierarchy of conclusions was attempt- 
ed: 


1. Retention or rejection of the null hypoth- 
eses that there were no significant differences 
between the groups in social and personal adjust- 
ment. 

2. Evaluation of differences, if sufficiently 
Significant to permit rejection of the hypotheses, 
to determine the relative advantages of promot- 
ed and nonpromoted groups. 

3. Analysis of any significant findings and the 
experimental design of the study to determine the 
contributions of the promotion factor in determ- 
ining existing difference. 


Testing the hypotheses. —Twenty-nine in- 
stances of significant difference, some involv- 
ing group differences on major sections of an 
instrument and others involving group differ- 
ences on major sections of an instrument and 
others involving only single items of instru- 
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ments, were identified. These ranged in sta- 
tistical significance from better than the 1 per- 
cent to about the 5 percent level of confidence. 
These data clearly reject the hypotheses and 
so they are re-worded below in the phrasing ap- 
propriate to the findings: 


1. There were differences in social adjust- 
ment between repeating and non-repeating school 
children. 

2. There were differences in personaladjust- 
ment between repeating and non-repeating school 
children. 


Evaluating the differences. —The fact that 
the nonpromoted children were more outward- 
going, according to sociometric data, probably 
would have been to the advantage of this group, 
were it not for the fact that rejection contrib- 
uted more than acceptance in producing this 
situation. Then, declining mutual acceptance 
bonds among members of the nonpromoted 
group could have been a desirable development 
had these children established other such bonds 
with classmates other than repeaters. This de- 
velopment appeared to be just part of a general- 
ly declining picture of mutual acceptance for 
nonpromoted children. 

Major trends of difference supported the gen- 
eral conclusion that differences in the area of 
peer-group relationships favored the promoted 
group. This conclusion was substantiated by 
findings on all three types of data collected. 
Another major trend suggested the conclusion 
that the promoted children were more disturbed 
personally over their school progress and their 
home security, concerns that appeared closely 
related to each other. It should be clearly point- 
ed out here that patterns of difference discrim- 
inate consistently neither between groups nor 
among individuals. The greater number of dif- 
ferences favoring the promoted group was count- 
erbalanced, in part, by certain significant dif- 
ferences favoring the nonpromoted group; ex- 
ceedingly high or low scores on given items for 
individual children were compensated for by low, 
medium, or high scores on other items. 

Accounting for differences. —It usually is a 
less difficult problem to identify the existence 
of differences than to account for their pres- 
ence. In the present study, a great many var- 
iables likely to influence social and personal 
adjustment had to be considered. Three ofthe 
most potent factors—chronological age, ment- 
alage, and achievement—were accounted for 
by equating the groups on these bases. In ad- 
dition, the schools chosen were neither pre - 
dominantly rural nor predominantly urbanand 
the fathers of the children selected represented 
similar occupational groups. Furthermore, the 
numbers of children enrolled in the first grades 
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of the schools from which promoted children 
were selected corresponded closely to the first- 
grade enrollments of the schools from whichnon- 
promoted children were selected. Other factors, 
such as the educational philosophies and facili- 
ties of the schools, teaching procedures, andso 
on, were to operate by chance on the assump- 
tions that the schools in this county system do 
not differ widely and that any differences, par- 
ticularly in quality of teaching, would be distrib- 
uted at random fairly evenly between promoted 
and nonpromoted groups. The experimentally 
differentiated factor was that of promotion; the 
promoted group was in its second year and sec- 
ond grade of schooling while the nonpromoted 
group was in its second year and first grade of 
schooling. 

To the extent that the influential factors left 
to operate by chance actually did contribute to 
both groups evenly, as assumed, and to the ex- 
tent that the learning environment of first and 
second grades are generally and fundamentally 
alike, the differences identified can be attribu- 
ted to the differentiating effects of promotion 
and nonpromotion. Obviously, then, the roles 
of promotion and nonpromotion can never be ac- 
counted for with absolute finality. Research 
procedures for reducing the abnormal opera- 
tion of chance factors are described in the next 
section. 

One set of differences, more than all the 
others, suggests grade placement as the major 
causal factor. This is the group of differences 
revealed through sociometric ‘‘best-friend’’ 
techniques. Promoted and nonpromoted child- 
ren were compared first to their own class~- 
mates; the relative positions of promoted child- 
ren then were compared to the relative positions 
of nonpromoted children. This dual comparison 
revealed promoted children to be rejected rel- 
atively less than nonpromoted children. Whether 
or not first-grade educational environments dif- 
fer fundamentally from second-grade environ- 
ments matters little, if at all; the important 
consideration is that nonpromoted children 
thrived less well than promoted children wien 
each group was compared to its own class group. 

The total body of evidence suggests the closer 
affiliation of undesirable social and personal ad- 
justment characteristics with nonpromotion than 
with promotion. Although the exact causal nature 
of this affiliation cannot be ascertained with fin- 
ality, there are clear indications that nonpro- 
motion is the less defensible educational prac- 
tice. 

Conclusions to the effect that some children 
experienced unsatisfactory social contacts, that 
some were worried over their school progress, 
that others were insecure in their home relation- 
ships, that certain children were experiencing 
difficulty in balancing success and failure, and 








GOODLAD 325 


so forth, have serious implications for the de- 
velopment of the individual personality. The 
fact that such conditions were found to a great- 
er degree in one group than in the other has, of 
course, important educational implications. 
However, they existed to a degree (andthe data 
suggest to a greater degree, on the whole, than 
normally would be expected) among the children 
of both groups. Case studies of disturbed indi- 
viduals reported in the psychological literature 
abound with references to such inadequate per- 
sonality adjustments; therapy for maladjustment 
among mature persons is a long, frequently un- 
successful, process. A more hopeful solution 
would seem to be attention to sound principles 
and practices of mental health while the individ- 
ual still is in his early, formative years. If un- 
wholesome personal development can be detect~ 
ed as early as the first school years, it can be 
treated and prevented also during these years, 
The job is not that of the school alone; it re- 
quires the cooperation of the home and all ag- 
encies devoted to the welfare of boys and girls 
if any significant reduction in the incidence of 
mental ill-health is to be accomplished. 


Recommendations 





For promotion and related administrative 
practices, —The findings of this study suggest 
the following recommendations related to the 
classification of pupils in graded schools: 





1. That each instance of proposed grade re- 
tention be critically examined. When an affirm- 
ative answer based on fact rather than opinion 
cannot conscientiously be given to the question, 
‘‘Is nonpromotion more likely to facilitate the 
all-round development of this child?’’, thenthat 
child should be promoted to the next grade. 

2. That teachers adopt a broad factual basis 
for the consideration of promotion and nonpro- 
motion. Facts related to achievement and intel- 
ligence are not sufficient; nor is the division in- 
to more categories of a limited body of inform- 
ation adequate. Desired are facts related toall 
phases of human growth, collected from a wid« 
range of sources throughout the year rather than 
during the last few weeks of school, and anal- 
yzed in the light of sound principles of child 
growth and development. 

3. That schools or entire school systems ex- 
amine their promotional practices critically to 
make sure that they are resulting in the best 
possibie development of boys and girls. Suchan 
evaluation should include a re-examinationand 
perhaps re-information of purposes, policies, 
and practices to make sure that they are philo- 
sophically and psychologically sound, consistent, 
and thoroughly understood by the entire per - 
sonnel. 
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For curriculum and instruction. —It will be 
recalled that not all differences favored the same 
group and that practically no individuals were 
consistently well or poorly adjusted according 
to the evaluative techniques used. Because of 
these patterns of variability, the following rec- 
ommendations are proposed: 





1. That desirable concepts, habits, skills, 
and attitudes be substituted for minimum essen- 
tials of subject matter in courses of studies. 
Subject matter thus would be relegated to its 
more appropriate and no less important role of 
a means to the development of desired behaviors 
rather than that of an end in itself. Subject 
matter then could be utilized according to the 
individual chiid’s location on his own growth 
continuum instead of according to a pre-determ- 
ined set of minimum essentials prescribed by a 
course of studies. 

2. That instructional procedures be as varied 


as the needs of the children enrolled in the class. 


The careful exercise of judgment in promoting 
or retaining a child does not constitute a guaran- 
tee of satisfactory subsequent adjustment for the 
child in question. The slow-progress child pro- 
moted to the second grade is likely to show up 
adversely if compared to any preconceived no- 
tions of how fast a ‘‘normal’’ second-grader 
should progress or if compared to the child whose 
normal rate of progress is considerably faster 
than his own. Normalcy should be thought of as 
an individual matter; a normal rate of progress 
for a given child is normal for him only. The 
job of the school and the teacher, then, is to 
take each child, whatever his grade placement 
may be, from where he now is to where he can 
go in each phase of his development; no more is 
possible, no less is enough. 

For school organization. Assigning grade 
labels and promoting or failing childrenat spec- 
ified periods represents just so much lost mo- 
tion when the philosophy of school progress is 
that of ‘‘taking each child from where he is to 
where he can go.’’ A plan of school organiza- 
tion that appears much more appropriate to this 
philosophy is that of ‘‘continuous progress’’, a 
plan that has been adopted at the primary level, 
grades one to three, in more than forty Milwau- 
kee schools. In these schools, the children are 
classified only according to the number of sem- 
esters spent in school; thus, a child who is be- 
ginning his third year is in the fifth semester. 
Most children enter the fourth grade at the end 
of the sixth semester but some may take seven, 
eight, or even nine semesters to travel from the 
first contact with school to the fourth grade. Of 
the plan, Faith says: 





It provides for the practical application 
of present-day educational philosophy. It 
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makes adjustment of teaching and ad- 
ministrative procedures easier tomeet 
the individual differences of children. 
It allows the bright child to go far be- 
yond the usual standard for his grad: 
without removing him too far from his 
social group. It encourages the slow 
child to the limit of his ability. Itre- 
lieves strains and fears and thereby 
promotes wholesome mental health (13). 


No evidence was given to support these 
claims. However, since they are in harmony 
with the basic philosophy and major purposes 
of forward-looking school systems throughout 
the country, the plan deserves careful attention. 
It is recommended, therefore, that similar 
plans of school organization be implemented on 
an experimental basis, with accompanying re- 
search into the growth and development of child- 
ren involved. It is further recommended that 
curriculum and instruction be adapted to con- 
form with the new plan of organization and its 
underlying philosophy. The following would be 
requisite here: 


1. Courses of studies of the type recommend- 
ed earlier in this section. 

2. Understanding by teachers of the develop- 
mental tasks faced by children involved. 

3. Understanding by teachers of teaching pro- 
cedures appropriate to assisting these children 
in the satisfactory accomplishment of these 
tasks. 

4. A wide range of instructional materials 
suited to the growth and developmental needs of 
all children represented. 

5. A reporting system designed to reveal in- 
dividual pupil growth and development. 


For further research. —Conduction of the 
present study has revealed the need for further 
investigation into the effects of promotion and 
nonpromotion and into closely-related fields. 
The following studies are recommended: 





1. Studies into the constancy of primary-grade 
friendship patterns. Studies already have shown 
that single instances, such as a home-party, can 
radically change the popularity of given children, 
but little is known about long-term fluctuations 
and the factors producing them, the effects of age 
and grade upon classroom social structure, and 
so forth. Such information would aid immeasur- 
ably in guiding the development of ele mentary 
school children. 

2. Studies into the achievement, attitudes, be- 
havior, and personal-social adjustment of child- 
ren embraced by plans of continual progress such 
as the Milwaukee plan. Too often, progressive 
plans of school organization and management have 
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become stagnant or discredited because of a 
failure to collect evidence that might have dis- 
closed existing weaknesses and provided for re- 
visions to conform with society’s ongoing 
changes. 

3. A more comprehensive investigation into 
current effects of promotion and nonpromotion 
based upon a slightly different experimental de- 
Sign than was used in the present study. It is 
Suggested that groups be matched, case-for- 
case, previous to rather than after the incidence 
of promotion or nonpromotion. The children 
matched should be drawn entirely from a group 
of potential repeaters; one member of each 
pair then should be selected for promotion to 
the next grade and one for retention in the pres- 
ent grade. Previous to such promotion and re- 
tention, however, the first administration of 
all evaluation instruments should take place. 
These instruments should be designed to meas- 
ure achievement, intelligence, attitudes, behav- 
ior, and personal-social adjustment. Thus, an 
entire year would have elapsed from initial to 
end administration of the instruments. Develop- 
ing anecdotal records, maintaining careful ob- 
servations, and holding interviews during the 
intervening period would serve not only to sup- 
ply corroborating evidence but also to provide 
insight into the dynamics back of any group dif- 
ferences ultimately identified. Sucha study 
would facilitate more clear-cut interpretation 
of differences at the causal level, even though 
final attribution of differences to the promotion 
factor still would not be irrevocably justified. 

This study suggests that repeating a grade 
is detrimental to the social and personal devel- 
opment of boys and girls. The evidence pre- 
sented, together with evidence irom other stud- 
ies that repetition is not conducive to greater 
efforts or achievement and that it is associated 
with undesirable school attitudes and behavior, 
seriously questions nonpromotion as a valid ed- 
ucational practice. This study further revealed, 
however, that neither all the selected promoted 
children nor all the selected nonpromoted child- 
ren were consistently well or poorly adjusted; 
there was considerable overlapping between 
groups and among the individuals of any one 
group. Such findings suggest that, whether slow- 
progress children be regularly or irregularly 
promoted, adequate subsequent provision for their 
needs is not being provided in our schools. It is 
recommended, therefore, that schools adopt, ex- 
perimentally, policies of regular progress and 
appropriate instructional techniques that meet 
the individual child where he is and guide him 
forward according to his own potentialities and 
capabilities. It is hoped that, as a result of the 
success of these procedures, promotion and non- 
promotion would have no place in our education- 
al vocabulary, just as they now merit no rightful 
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place in forward-looking educational thought 
and practice. 
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A SUBSTRATA ANALYSIS OF SPELLING 
ABILITY FOR ELEMENTS OF AUDI- 
TORY IMAGES* 


JACK A. HOLMES** 
University of California 
Berkeley, California 


SECTION I 
THE PROBLEM AND ITS BACKGROUND 
A. Introduction 


1. The Problem and Hypothesis 





THE PURPOSE of this study is to inves- 
tigate the auditory aspect of the general hypoth- 
esis: Spelling ability at the high school and uni- 
versity levels is an integrated composite of a mul- 
tiplicity of sub-abilities which may be identified 
in a general way as falling into the visual, aud- 
itory, and kinaesthetic areas. Individual differ- 
ences in spelling ability may be accounted for in 
part by individual differences in the ability to 
handle phonetic associations; and since bothabil- 
ities presumably depend in part upon the ability 
to discriminate the various elements incomplex 
sound patterns, the following specific hypothesis 
is tenable: A cluster of musical elements under- 
lies individual differences in spelling ability and 
the ability to make phonetic association. The 
specific purposes of this experiment, therefore, 
are: 





1. To discover the cluster of musical elem- 
ents which are related to individual differ- 
ences in spelling ability; 

. To discover the relationships between 
spelling ability, phonetic association, in- 
telligence, and the elements of auditory 
images; and 





3. To calculate the contributions to variance 
which each of the substrata musical elem- 
ents makes to spelling ability. 


2. The Literature and Rationale of the Study 





The visual image of a picture can be described 
in terms of line, form, color, texture, etc., and 
Similarly, an auditory image of a word is pre- 
sumably composed of certain auditory and/or 
musical elements which are more fundamental 
than the gestalt itself. The fundamental signif- 
icance of this study lies in its effort to pin down 
the specific elements which go to make up that 
elusive and generalized ‘‘auditory imagery’’ with 
which the literature on spelling abounds. Dolch 
(10), for instance, says, ‘‘ear-spelling will al- 
ways be widely used.’’ Hartman (18,19) con- 
cludes that spelling ability is no more a function 
of general visual perception than it is of general 
auditory perception; however, he goes on to in- 
dicate that it is largely dependent upon one form 
of visual reaction—accuracy of immediate word- 
form perception—and dismisses the implications 
of the auditory elements without further ado. 
Likewise, Humphrey (26), Nolde (33), and Tidy- 
man (47) indicate that spelling ability develops 
around three basic types of imagery: auditory, 
visual, and kinaesthetic; but become no more 
specific than to name the auditory factor as a 
general term. 

McGovney (29) found that the most significant 
difference between good and poor spellers was 
the ability to give sounds for letters and sylla- 
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bles, and to perceive small differences inwords, 
Others (8, 9,25) find that ‘‘training in auditory- 
visual discrimination’’ helps improve spelling 
ability, but the terms used are so general that 

a teacher wishing to build content into a course 
which contained the fundamental elements as well 
as the generalized ‘‘training in hearing’’ would 
be at a loss to know where to begin or what to 
place in his course. 

In apparent opposition to the above, Gates et 
al., (14), found that the deaf were almost four 
years superior to normals in spelling when read- 
ing was held constant. However, the technique 
of holding reading constant, it must be remem- 
bered, may have resulted in an over-correction. 
Kiefer, et al., (27) found that while many poor 
spellers had defective vision, none had defective 
hearing. Kiefer’s data were not substantiated 
by Russell's (38) who found no reliable differ- 
ence between good and poor spellers on the Betts’ 
Telebinocular. Russell (38), Spache (43, 44), 
and Templin (45) all supply data which would in- 
dicate that either no difference on an Audiometer 
Test for good and poor spellers can be found, 
or if found the relationship will be of an inverse 
nature. The greater the loss in auditory acuity, 
the better the speller! Alper (1), Cook and 
O’Shea (6), and Mendenhall (30) agree in their 
findings that the most frequent types of spelling 
errors can be classified as phonetic or distorted- 
phonetic. A much smaller number are classi- 
fied as non-phonetic. Likewise, Archer (2) and 
Carroll (5) both find that bright children make 
more phonetic errors in spelling than do dull 
children. Hildreth (20) and Miller, et al., (32) 
both emphasize that the child shouid be taught 
the common phonetic elements if he is to be a 
good speller. 

Gates and Russell (15) have stressed memory 
for sounds as one of the ‘‘inherent’’ difficulties 
in bringing about spelling readiness. Hincks (21) 
decided that nearly all her poor spellers were 
monotones. She says that 72 percent of her poor 
spellers were below average in pitch discrimin- 
ation. However, she not only neglects to com- 
pare them with average or good spellers, but her 
sample was very small (N= 15). Her results 
were based on an inability to sing and an inabil- 
ity to rhyme in building word-families. While 
Phelan (35) could isolate no general factor in 
nine perception tests, his analysis did indicate 
that the following factors made specific contri- 
butions to the variance of spelling ability: 


Rote Memory for Words 
and Letters 1. 97% 
Cognition 39.20 
Visual Perception for Words 10. 07 
Not accounted for 48.76 
100. 00% 
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Russell (38) did find a functional auditory factor 
in that on auditory discrimination of words of 
similar sounds the normals did significantly 
better than the poor spellers. Schonell (40), 
Spache (42), Palmer (34), Horn (24), and Wat- 
son (48) may be said to be in basic agreement 
with the finding that good spellers excel the poor 
spellers in phonetics and ability to make audi- 
tory discriminations, but again these authori- 
ties seldom become more specific in respect to 
the fundamental auditory elements involvedthan 
to use such phrases as the ‘‘most potent cause 
of disability in spelling’’ is an ‘‘intense func- 
tional paraphemia,’’ or, an inability to give 
the ‘‘rhythmic pattern of words. ”’ 

In summarizing the literature dealing with 
the relationship of the elements of music to 
phonetic- and spelling-ability, one might say 
that Russell’s (38) study is the most represent- 
ative in that within his separate findings one may 
find the anomaly. On the one hand he finds no 
difference on an audiometer test for good and 
poor spellers, and on the other hand he found a 
‘functional auditory factor’’ in that on auditory 
discrimination the normals did better than poor 
spellers. The general concensus of opinion, 
based on experimental, clinical, and classroom 
experiences, appears to be that auditory dis- 
crimination and phonic skills are very import- 
ant to spelling ability, but to the writer’s knowl- 
edge no investigator has attempted a systematic 
experiment to determine the fundamental elem- 
ents of the auditory images which must underlie 
individual differences in the ability to form aud- 
itory images, preparatory to the spelling of 
words. This study attempts such an investiga- 
tion. 


3. Importance of the Problem 





If it can be shown that spelling ability is sig- 
nificantly related to phonetic ability and that 
both spelling ability and phonetic ability depend 
to a significant extent upon certain fundamental 
elements now generally considered as particu- 
larly associated with musical ability, then sev- 
eral possibilities become apparent: From a 
theoretical point of view, it should give the ed- 
ucational psychologist greater insight into an 
understanding of what makes for individual dif- 
ferences in ability to spell. Secondly, the el- 
ements once identified could be further tested 
to determine whether or not they were heredity 
bound talents or whether they could be trained. 
The schools now expend most of their music- 
teaching time on students who show some prom- 
ise or interest in music. Since Gilbert and 
Gilbert (16), Russell (39), and Holmes (22) 
have all found that spelling and reading are re- 
lated, the schools may be overlooking the very 
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students who are most in need of music training 
as a concomitant learning basic to such academ- 
ic skills as spelling and reading. In short, only 
when the schools know what musical elements 
are important in the formations of auditory-word 
images can they hope to understand the dynamics 
of learning such images. Meaningful remedial 
teaching of spelling must depend upon meaning- 
ful diagnosis of spelling weaknesses, and mean- 
ingful diagnosis must in its turn depend upon 
knowing and assessing the visual, auditory, and 
kinaesthetic elements which form the basis of in- 
dividual differences in spelling ability. 


SECTION II 
SOURCES OF DATA 


A. The Populations Sampled 


1. The High School Group 





A random sample of 227 University of Cali- 
fornia Demonstration Secondary School students, 
between the ages of fifteen and eighteen years 
inclusive, constitute the High School Group. 
This sample was drawn from those students tak- 
ing the English and Social Science classes in the 
summer of 1951. 


2. The First University Group 





A random sample of 91 University of Califor- 
nia students enrolled in the writer’s Education- 
al Psychology class, Spring 1951, make up the 
First University Group. 


3. The Second University Group 





A random sample of 102 University of Cali- 
fornia students enrolled in the writer’s Educa- 
tional Psychology class, Fall 1951, make up the 
Second University Group. 

The students in both university groups are, 
for the most part, juniors and seniors and are 
homogeneous to the extent that their major inter- 
est is in the field of education. 


B. The Test Batteries 


1. The Battery Used with the High School Group 





The criterion, spelling ability, was derived 
from scores on a 5-choice multiple-choice spell- 
ing test. The 35-item test was made by using 
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tables of random numbers in order to distribute 
the correct choices through the list. The words 
used were taken from Groves’ (17) study and 
therefore were of known difficulty. The words 
were placed in order of increasing difficulty. 
The particular merit of the wrong choices was 
that they were the high frequency misspell- 
ings reported in the above mentioned study. 

The independent variables were assessed on 
a phonetic association test and on a modification 
of the Kwalwasser-Dykema Music Test ! (23). 
The High School Phonetic Association Test, Form 
A, is composed of 100 items selected in sucha 
way as to sample most of the phonetic elements 
presented in a standard elementary course in 
phonetics. In this test the student is givena 
minimum number of cue-letters for each word. 
The key phonetic element being tested in each 
item is either omitted or substituted for, sothat 
in order to recognize the word the student must 
sound the strangely spelled word out to himself 
and can identify it only by its sound. For in- 
stance, ‘‘mlk,’’ ‘‘laf,’’ and ‘‘sertn’’ are some 
of the more obvious examples. Errors in spell- 
ing were not deducted for in this test. 

Table I lists the tests used in this battery 
along with their reliabilities. 


2. The Battery Used with the First University 
Group 


Two criteria for spelling ability were used 
in the First University Group. In the first cri- 
terion 79 words selected from various spelling 
scales, such as those given by Ayer (3), and 
Buckingham and Dolch (4), and from such stand- 
ard free association lists as those given by Ros- 
anoff (37) and Rapaport (36) were used. The list 
was administered orally and the students were 
instructed to write the words in one of three col- 
umns depending upon how they felt toward the 
word. The test was called a Word Pleasantness 
Test and the emphasis was placed on putting the 
word in the (P) Pleasant, (I) Indifferent, or (U) 
Unpleasant column rather than on trying tospell 
the word correctly. This technique was calcu- 
lated to reduce cheating, carry over, and also 
to sample the student’s spelling ability under 
conditions which more normally approximated 
the task of spelling a word which comes to mind 
while writing. This test was giveninthe first 
month of the semester. 

The second criterion for spelling ability 
used with this group was a 5-choice multiple- 
choice spelling test of 50 items. The words 
were selected from missed items in the above 
Word Pleasantness Test. The wrong choices 








1. The modifications of the K-D Test made by Holmes (23) were of such a nature as to raise the relia- 
bilities to where the subtests were useful as research and diagnostic instruments. 
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TABLE I 


THE TESTS AND THEIR RELIABILITIES* 
(The High School Group) 





Tests 





Criterion 
1. High School Spelling Test, Form A, M:C 
by J. A. Holmes (Mimeographed) 


Independent Variables 
2. High School Phonetic Association Test, Form A 
by J. A. Holmes (Mimeographed) 


. Kwalwasser-Dykema Music Test as Modified by 
Holmes, ** 


a. Tonal Memory 

b. Quality Discrimination 
*. Intensity Discrimination 
. Tonal Movement 


. Rhythm Discrimination 
. Pitch Discrimination 
. Melodic Taste 


237 
237 
237 
237 
237 
237 
237 
237 
237 





corrected by the Spearman-Brown Prophecy Formula. 
**Cf. Holmes (23). 


* All reliability r’s given were obtained by the odd-even split-half technique and 
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were made from high frequency misses as tal- 
lied from the responses given by the university 
students earlier inthe term. The items in- 
creased in difficulty and the correct choices 
were distributed from item to item as dictated 
by the tables of random numbers. This test was 
given on the last day of the semester. 

The independent variables consisted of the 
**Q’’ and ‘‘L’’ scores of the American Council 
on Education Test, 1949, and the elements of 
auditory images were assessed on the Seashore 
Measure of Musical Talents Test (41). Table II 
presents the tests and their reliabilities. 


3, The Battery Used with the Second University 
Group 


The criterion for spelling ability used in the 
Second University Group was the same multiple- 
choice spelling test used with the First Univer- 
sity Group. 

The independent variables consisted of the 
‘*@’’ and ‘‘L’’ scores of the ACE, 1948, and the 
Form B of the Phonetic Association Test used 
with the High School Group. Table II presents 
the tests and their reliabilities. 





SECTION III 


STATISTICAL PROCEDURES, ANALYSIS AND 
RESULTS 


Tables III, V, and VII present the matrices 
of intercorrelations, the means, and standard 
deviations of the variables for each of the sam- 
ples. All correiations were of the product- 
moment type. In order to be sure that the factor 
of age could be held constant, it was included in 
the intercorrelation matrix of the High School 
Group and was also calculated for the First Un- 
iversity Group. 


A. The Substrata Analysis 


The intercorrelation matrix of each of the 
three samples was submitted to the same type 
of statistical analysis. The statistical technique 
used was an extension of the Wherry-Doolittle 
(13) test selection method as developed by Holmes 
(22). This extension makes it applicable to a 
substrata analysis of the factors which underlie 
success in a given criterion. While the Wherry- 
Doolittle method gives the test factors (which 
underlie predicted success) in the first order of 
magnitude, the extension of the method will al- 
low the extraction of the test factors in the high- 
er orders. The test factors in the successive 
orders were extracted until a point of diminishing 
returns was reached. 
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B. The Substrata Analysis of the High School 
Group 


Table II presents the 55 intercorrelations, 
means, and standard deviations for the 227 high 
school students. Several things in this table 
are of interest in the light of the hypothesis be- 
ing investigated. 

Spelling ability as assessed on a multiple- 
choice type of examination which demands rec- 
ognition rather than absolute recall shows a .726 
correlation with the phonetic association test. 
Age within the limits investigated shows no sig- 
nificant relationship with the ability to spell. 

The zero-order correlations of the modified 
form of the Kwalwasser-Dykema Music Test 
(23) with spelling attest to the fact that five of 
the eight subtests are significant at the one per- 
cent level of confidence. An additional two more 
are significant at the five percent level. Tonal 
Movement has the highest zero-order correla- 
tion with spelling; the r is .429. Rhythm, Pitch, 
and Tonal Memory follow with r’s which run 
from .338 to . 300. 


1, First Order Factors Underlying Spelling 
Abilit 


The matrix, Table III, was submitted to the 
Wherry-Doolittle test selection methodin order 
to solve the multiple correlation problem: Of the 
variables sampled, which constitute the primary 
test factors underlying the ability to spellatthe 
high school level? Table IV presents the pert- 
inent data as they developed in the successive 
primary solutions of the shrinkage formula 








R = VI - K? (N- i/n- m) 


inwhich R is the ‘‘shrunken multiple correlation 
coefficient, the coefficient from which chance 
error has been removed. ’’ (13) 

From Table IV it may be noted that, of the 
seven musical elements which showed a signifi- 
cant zero-order relation to spelling ability, only 
one, Tonal Movement, is left to make an inde- 
pendent contribution to the criterionafter the 
variable Phonetic Association has been taken in- 
to account. From column ‘‘g’’ it is evident that 
spelling ability may be predicted with an R of 
.733 when Tonal Movement is added to Phonetic 
Association. Since R* may be expressed in 
terms of the beta coefficients for the zero-order 
r’s, the proper substitutions in the general form- 
ula, 


R¢(2, 7) = Bz (te2) + Bz (r_7) 


yields the R? which is the contribution to vari- 
ance that this team of tests makes to Spelling 
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TABLE I 


THE TESTS AND THEIR RELIABILITIES* 
(The University Group) 


(Vol. XXII 








Tests 





First Group 
Criteria 
1. Word Pleasantness Scale for College Students: 
Form 3, Spelling-W:P by J. A. Holmes............. 


. College Level Spelling Test: Form A, M:C 
by J. A. Holmes (Mimeographed) 


Independent Variables 
3. ‘‘Q’’ Scale of ACE, 1949 


4. ‘‘L’’ Scale of ACE, 1949 
5. Seashore Test of Musical Talents: Full Scale** 
a. Pitch Discrimination 
. Intensity Discrimination 


. Time Discrimination 


e, 


S. 


Second Group 
Criterion 
1. College Level Spelling Test: Form A, M:C 
by J. A. Holmes (Mimeographed) 


Independent Variables 
2. ‘*Q’’ Scale of ACE, 1948 


3. ‘*L’’ Scale of ACE, 1948 


4. Phonetic Association Test: Form B 
by J. A. Holmes (Mimeographed) 


. 76 


-91 


. 95 


. 93 


160 adults 
160 
160 
58 
160 
160 


198 


102 


102 


102 





* All reliabilities are of the corrected split-half type as derived by the writer on the 
group, unless stated otherwise. 

**Cf. Seashore (41). 

*?Reliability for consonance from McCarthy's study (28). All other reliabilities for 
the Seashore Test are from Whitley’s study (50). 
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Ability-M:C at the high school level. Further, 
each of the separate terms of the equation gives 
the contribution to variance which each test 
makes to the criterion. 

Solution of the equation reveals that, ofall , 
the variables which go to make for individual 
differences in the high ;chool student’s ability 
to spell, 54 percent of the variance can be at- 
tributed to differences in their ability to handle 
phonetic associations and to discriminate and 
anticipate good tonal movements. A breakdown 
of the contributions which the independent vari- 
ables made to Spelling-M:C2 Ability are: 


48. 4% 
5.5 
46.1 


Phonetic Assoviation 
Tonal Movement 
Unaccounted for 


That part of the variance which remains unac- 
counted for is substanti4l and must be sought in 
other factors. One woujd expect this since the 
relation of the visual perception of word-forms 
to spelling (Phelan, 35), the kinaesthetic asso- 
ciations of writing to spelling (Fernald, 12), and 
the relationship of inteliigence to spelling were 
not assessed in the present experiment. The sig- 
nificant thing is, of course, that some of the var- 
iance could be attributed to the musical element 
Tonal Movement, even after ability in phonetic 
associations had been partialed out. 


2. Second Order Factor: Underlying Spelling 
Ability 


From the primary analysis above, it is evi- 
dent that the variable, phonetic association, car- 
ries a heavy loading; therefore, it is important, 
both theoretically and for the practical purpose 
of teaching spelling and phonetics, to ask: What 
are the skills, abilities, and aptitudes basic to 
the ability to handle phonetic associations? More 
to the point of the present study is the question 
subsumed in the question just asked; that is, 
what are the elements of music which are func- 
tionally fundamental in the ability to make phon- 
etic associations? To answer this query, a sub- 
strata-analysis was made by deleting spelling 
and its intercorrelations {rom the matrix in Table 
Ill and allowing phonetic association to bec ome 
the sub-criterion for a secondary multiple cor- 
relation analysis on the variables which were 
left. 

The substrata analysis on this secondary lev- 
el reveals that the correlation between Phonetic 
Association and Tonal Movement is . 454, and 
that the multiple correlation is increased to .505 
when Pitch is next precipitated out of the matrix. 
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The multiple rises to .514 when Intensity, the 
final test t come out, is precipitated. When 
the zero-order correlations are multiplied by 
their proper beta weights, it can be shown that 
the musical components functionally fundament- 
al in phonetic associations, with their independ- 
ent contributions to variance, are: 


Tonal Movement 13. 
Pitch 10. 
Intensity . 
Total 27.1% 


Reflection on the factors precipitated in the 
primary and secondary analysis will reveala 
substrata organization of the variables andtheir 
contributions to spelling which can be represent- 
ed as shown on the next page. 

As for the percents given in the second order 
of the schemata: If one takes 13.6 percent of 
48. 4 percent, it becomes apparent that Tonal 
Movement contributes about 6.6 percent to the 
spelling variance through phonetic association. 
Therefore, Tonal Movement makes a total con- 
tribution to spelling ability of about 12.1 per- 
cent. Pitch contributes 5.1 percent, and Inten- 
sity another 1.4 percent. In other words, these 
three elements of music make a functionally de- 
tectable contribution to Spelling-M:C which will 
account for 18.6 percent or nearly one-fifth of 
the total variance. Statistically then, the hy- 
pothesis is well substantiated at the high school 
level. 


3. Third Order Factors Underlying Spelling 
Ability 


Is Tonal Movement a more compiex, less 
fundamental factor than most of the other elem- 
ents in the revised K-D Test? The musical au- 
thorities the writer has sought in this connec- 
tion seem to think this is the case. If on musi- 
cal and/or psychological grounds a higher com- 
plexity can be assumed, then it is justifiable, 
though not necessary to the proof of the major 
hypothesis under investigation, to ask: What 
are the more basic musical elements involved 
in this more complex element Tonal Movement, 
and what part of the variance must we leave as 
a residual contribution to the element itself? 

With full realization of the above assumption, 
that Tonal Movement is of a higher complexity 
than some of the other musical elements, a 
tertiary substrata analysis was made. If Ton- 
al Movement makes not only a substantial con- 
tribution to spelling ability in the primary an- 
alysis but also makes a substantial contribution 








26 Spelling-M:C is used to indicate the multiple-choice spelling test criterion. 
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Tonal Movement 
(5. 5°) 


Phonetic Assoc. 
(48.4% —13.1%) 


Unaccounted for 
(46. 1%) 


Spelling-M:C 
(100%) 


to spelling through phonetic associations in the 
secondary analysis, then whatare the more 
fundamental musical elements which underlie 
it? Pursuing the statistical methods outlined 
above, it is easy to show that about 40 percent 
of the variance which goes to make for individ- 
ual differences in Tonal Movement can actually 
be attributed to Tonal Memory, Rhythm, Pitch, 
and Melodic Taste. The multiple R sequence 
starts at .522 and increases .595, .618, to fin- 
ally stop at .631. When the beta weights are 
combined with the zero-order r’s of these ele- 
ments, the following contributions to the vari- 
ance of Tonal Movement are: 


_ Tonal Memory (14.2%) 


—__ Pitch (11.4%) 

Tonal Move. ——_____ Rhythm (11.0%) 
(100%) Melodic Taste ( 3.2%) 
Residual (60.2%) 


The breakdown contributions which these elem~- 
ents make through Tonal Movement direct to 
spelling and through Phonetic Association to 
spelling are important and therefore have been 
calculated, but to save space they are present- 
ed only in the final Summary of the Study, Sec- 
tion IV. 


4. Summary of the Statistical Analysis on the 
High School Group 








The ability to make phonetic associations per 
se apparently accounts for nearly half of the var- 
iance making for individual difference in Spelling- 
M:C Ability at the high school level. Tonal Move- 
ment, Pitch, Intensity, Rhythm, and Melodic 
Taste appear to be the most important musical 
elements (of those tested) functioning directly and 
indirectly through phonetics to make for individ- 
ual differences in the ability to spell at the high 
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Tonal Movement 
(6. 6%) 


Intensity 
(1. #) 


school level. Approximately 20 percent of the 
variance in spelling can be accounted for by 
these elements. 

Although the analysis did not deal with the 
relationship of Spelling-M:C to the total Holmes 
(23) modified K-D score, it is interesting to 
note that the correlation between these two fac- 
tors was as high as .401. Between phonetic as- 
sociations and the total (23) modified K-Dscore, 
the r was .475. This is important corroborat- 
ing evidence since the reliabilities of these three 
tests are all .90 or higher. 


C. The Substrata Analysis of the First Uni- 
versity Group ‘ 


Table V presents the 45 intercorrelations, 
means, and standard deviations for the ten var- 
iables tested. The First University Group con- 
sisted of 91 juniors and seniors taking Educa- 
tional Psychology. Several interesting obser- 
vations may be made direct from the table. 

Spelling ability, whenassessed ona dictation- 
write-in type of spelling test, correlates to the 
extent of . 823 with spelling ability assessed on 
a 5-choice multiple-choice type of spelling test 
when the difficulty of the words used is equiva- 
lent. Further, as far as the statistical signifi- 
cance is concerned, both the ‘‘Q’’ and the ‘‘L’’ 
of the Psychological Examination for intelligence 
are almost identically correlated with both the 
W:P and M:C spelling scores. Correlations of 
.221 and .210 express the relationship of the 
**Q’’-scores to both types of spelling scores, 
and the r’s of .528 and .534 express their re- 
lationship to the ‘‘L’’ scores. While the ‘‘Q”’’ 
relationship to spelling does not come up to 
the level of significance ordinarily admissible, 
the ‘‘L’’ relationship to spelling is highly sig- 
nificant—much etter than the one percent level 
of confidence. 
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Reference to Table V in regard to the rela- 
tionship between spelling and the elements of 
music as assessed by the Seashore Measures of 
Musical Talents (41) reveals that Tonal Memory 
and Pitch give correlations significant at the one 
percent level. These relationships do not hold 
when spelling is assessed on the multiple-choice 
type of test at the university level. However,it 
is significant to note that while both Intensity 
and Consonance or harmony have r’s with spell- 
ing-W:P which stand at the 5 percent level, only 
Intensity holds when the M:C-type of spelling 
test is used as the criterion. 

Part of the explanation for the fact that lower 
correlations were found between spelling and 
the elements of music in this group than in the 
high school group may be sought in the higher 
selectivity and reduced variability of the univer- 
sity group. However, two other explanations 
also tenable are, (a) that the university M:C - 
Spelling test had a lower reliability than the high 
school M:C-test even though it was longer by fif- 
teen items, and (b) the distribution was slightly 
skewed. The fact is, the M:C-spelling test at 
the university level did not have sufficient top 
to array the better spellers. Since this was not 
the case with the W:P-Spelling test, and since 
the words missed on the W:P-test were the very 
ones used in the construction of the M:C-test, 
it follows that the M:C-Spelling test was easier. 
This could be because there was carry -over 
from the W:P to M:C testings, although several 
months intervened, because recognition within 
structured limits is easier than recall, and/or 
because more of the substrata elements of aud- 
itory imagery must be called upon to cue word- 
spelling discriminations in the W:P-Spelling 
test than is necessary to discriminate word- 
spellings where visual-multiple-choice images 
are the dominant cues offered. The statistics 
about to be offered tend to support the last ex- 
planations, although it is fully recognized that 
the others are involved. 

Although the data were not included in Table 
V, it is pertinent to the reader’s insight before 
going on to the analysis to know that the correl- 
ation between Spelling W:P and Total Score on 
the ACE intelligence test was .452, between 
Spelling M:C and the Total ACE the r was also 
.452. Both of the correlations are identical and 
both are lower than the relationships which the 
two spelling tests show to the ‘‘L’’-linguistic or 
verbal part of the ACE intelligence test. 

Further, while Age relationships are not giv- 
en in the matrix in Table V, the calculations 
were made. Spelling-W:P correlated with age 
to the extent of -. 038; with Spelling M:C the r 
was +.053. Likewise, the plus and minus cor- 
relations between age and the various elements 
of music measured did not differ significantly 
from zero. All these age r’s were of the order 
of +. 04. 
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1. First Order Factors Underlying Spelling- 
W:P Ability 


Following the procedure described in the sec- 
tion dealing with the statistics for handling the 
High School Group the matrix, Table V, was 
submitted to a substrata analysis. 

The first question is: Which of the variables 
sampled constitute the primary test factors un- 
derlying the ability to spell when the criterion 
is the number of words correctly spelled ona 
dictation-write-in type of Spelling-W:P test’? 
Table VI presents the data as they develop in 
the successive primary solutions of the shrink- 
age formula (13). 

From Table VI it is evident that the spelling- 
M:C factor precipitated from the matrix first. 
One would expect this as experience makes it 
very clear that the visual-word-form-image is 
the dominant cue-discriminating factor used by 
most students in spelling words. The Spelling- 
M:C test was loaded with visual cues. What is 
important, however, as far as the hypothesis 
being investigated is concerned (i.e., that func- 
tionally some of the elements of music also play 
a significant role in spelling ability), is the fact 
that Tonal Memory and Pitch raise the multiple 
correlation from . 823 to .847. Apparently, 
these elements of music make a contribution to 
the dictation-write-in type of spelling ability 
which is over and above the aggregate of abili- 
ties which function to make for individual differ- 
ences in Spelling-M:C at the university level 
(when Spelling-M:C is assessed on a test where 
success is dependent predominantly on discrin - 
ination by visual-word-form cues), When the 
zero-order correlations are multiplied by the 
proper beta weights it follows that the first- 
order test factors which underlie the criterion, 
dictation-write-in type of Spelling-W:P test, 
with their independent contributions to variance 
are: 





Spelling-M:C 
Tonal Memory 
Pitch 
Unaccounted for 


The unaccounted for variance of 27.5 percent 
is appreciable and perhaps can be explained in 
that part of the test scores which represent the 
unreliability of each test. It is also tenable to 
Suppose that had other factors been tested more 
of the variance would have been accounted for. 
A case in point where evidence seems ample 
would be such a variable as Tonal Movement. 
Recall that of all the musical elements used on 
the High School Group, Tonal Movement made 
the greatest contribution to spelling. It is re- 
grettable for our purpose that this element was 
not included in the Seashore battery. 
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TABLE VI 


WORK SHEET FOR CALCULATING FINAL STEPS ON SUCCESSIVELY CORRECTED MULTIPLE R's 
FOR SPELLING-W:P FIRST ORDER FACTORS FOR THE FIRST UNIVERSITY GROUP 











Spelling-M:C 
Tonal Memory 


Pitch 





TABLE VII 


INTERCORRELATIONS, MEANS, AND STANDARD DEVIATIONS FOR 
SPELLING ABILITY AND THE INDEPENDENT VARIABLES 
TESTED IN THE SECOND UNIVERSITY GROUP (N=102)* 





Variables 





. Spelling-M:C 
“*Q’’ (ACE, 1948) 
. **L”’ (ACE, 1948) 


. Phonetic Association 





M. Mean 40.9 ‘ 83.2 50. 
2.3 ; 9. 


1 
o Standard Dev. 16.5 6 





*Correlations must be . 25 to be significant at the one percent level. 
IBM and hand calculations carried to six significant figures. 
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. Second-Order Factors Underlying 
Spelling-W:P Ability 








From the primary analysis just reported it 
is evident that the variable Spelling-M:C carries 
a heavy loading and therefore it is important to 
ask: What are the skills, abilities, and aptitudes 
basic to the ability to spell when spelling is as- 
sessed on a visual discrimination test? More 
specific to the hypothesis is the question: What 
part of the Spelling-M:C score can be accounted 
for by the ‘‘Q”’ and ‘‘L’’ factors of inte lligence 
and is their variance specific to some of the el- 
ements of music? 

To answer this question, a substrata-analy- 
sis was made by deleting Spelling-W:P and its 
intercorrelations from the matrix in Table Vand 
allowing Spelling-M:C to become the new sub- 
criterion for a secondary multiple correlation 
analysis on the variables which were left. 

The substrata-analysis on the secondary lev- 
el reveals that the correlation between Spe lling- 
M:C and ‘‘L’’-score of the ACE intelligence test 
is .535. The multiple correlation between Spel- 
ling-M:C and the ‘‘L’’-score plus the ‘‘@’’-score 
rises to .546. However, the increase is accom- 
plished in the calculations by a reversal in the 
usual sign of the V, entry. This is brought about 
by the high intercorrelation between the ‘‘Q’’ and 
the ‘‘L’’ scores obtained in the present sample 
on the 1949 ACE Test. Multiplying the zero- 
order correlations by the beta weights gives us 
the contributions to variance for the components 
which underlie Spelling-M:C. These are: 


34, 2% 
- 3.™% 


Reflection on the contribution which ‘‘L’’- 
type intelligence makes to the Spelling-M:C test. 
is not hard to justify. The negative contribution 
which the ‘‘Q’’-score makes to the test, however, 
is more difficult to handle. Apparently, it means 
either that the true contribution of the ‘‘Q’’- 
score is zero, and the negative contribution is 
a chance deviation from a true zero relationship 
between this type of spelling ability and ‘‘Q’’- 
type intelligence, or it actually means that 
when the linguistic or verbalabilities are held 
constant, the relationship between ‘‘Q’’ and spel- 
ling ability is slightly negative! Since the Wherry 
shrinkage formula professes to remove chance 
error from the multiple correlation coefficient 
it appears that the latter alternative must be 
tentatively held—held for verification. 

A flow-sheet diagram of how the first- and 
second-order factors contribute to Spelling-W:P 
in the first University Group would appear then, 
is shown at top of the next page. 


‘«L’’-type intelligence 
**Q’’-type intelligence 








3. A works on B, B on A, and AB may work on Ce 
le Not necessarily equal in both directions. 
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3. Third-Order Factors Underlying 
Spelling-W:P Ability 








The linguistic or L-type of intelligence makes 
such heavy contributions to both types of spell- 
ing scores (the W:P and the M:C techniques must 
both assay different aspects of the same spelling 
ability) that the question arises: Does any part 
of the verbal ability depend upon a potential to 
discriminate in the area of auditory images’? 
Convention should immediately make one look 
with some mistrust at the question just stated, 
for practice and theory in the field of psycholog- 
ical testing has tended to teach that intelligence 
is basic, be it in terms of a ‘‘general-G"’ or in 
terms of ‘‘primary-abilities’’ such as induction, 
spatial, perceptual, numerical, verbal, etc. It 
is true that Wechsler (49) has called on psychol- 
ogists to recognize that part which ‘‘non-intell- 
igence’’ or ‘‘personality factors’’ play, not only 
in life-behavior but also in individual intelligence 
test scores. Again, Davis, etal., (7,11) has 
stressed the importance of cultural differences 
in response to various intelligence test items. 
What the present writer is asking for is a recog- 
nition of the fact that other basic abilities which 
psychological convention does not include as con- 
stituting part of the realm of intelligence or per- 
sonality, nor yet cultural background, may not 
only play a role in school life behavior but also 
in the conventional intelligence test scores. 

Psychological convention will also bring an- 
other train of thought to the reader; that is, any 
correlation found between intelligence and any 
element of an auditory image expresses the part 
that intelligence plays in the function of the aud- 
itory element and not the reverse. To this ob- 
jection, it is well to reflect that statistical au- 
thorities agree that correlation, while indicat- 
ing relationship, does not give cause and effect 
data. In other words, from a coefficient of cor- 
relation one cannot determine what is cause 
and what is effect; such determination must be 
left to psychological insight, logical analysis, 
experimental design, or finally, commonsense. 
Psycho-educational insight into the present ques- 
tion would indicate to the writer, at least, that 
while for statistical convenience a logical se - 
quence of substrata elements must be postulated 
for any school subject, in reality a mutual3-and- 
reciprocal causation must actually be the case, 
Mutual-and-reciprocal causation may be thought 
of as the relative4-impact-support which factor 
A gives to B and B to A when B is the morecom- 
plicated, complex, or more difficult ability. 

The uses of the more elemental-A in learning 
to use the more difficult-B results not only in 
development of B but also in a sharpening, a 
differentiating refinement, a knowledge of, and 
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facility with the element-A. Mutual-reciproca- 
tion-of-cause-and-effect, therefore, must (if 
the logic of the above theory is admissible) func- 
tion in the dynamics of intellectual behavior as 
well as in the dynamics of learning. Holding this 
hypothesis to be tenable: then, a sub-analysis of 
the ‘‘L’’-score was made to determine if per - 
chance some of the elements of auditory images 
assayed in this study could be thought of as un- 
derlying the verbal intelligence test score. Of 
the elements tested in the First University Group 
two were found to make such a contribution to 
the ‘‘L’’-score, they and their contributions to 
variance are: 


Intensity 9. T% 
Pitch 4. 5% 


4. Summary of the Statistical Analysis on the 
First University Group 








Spelling ability was assessed on a dictation- 
write-in-type test and also on a 5-choice multi- 
ple-choice type test. The dictation-write-in- 
type test was used as the criterion ‘‘spelling a- 
bility’’ as it was believed to more closely sim- 
ulate the functional spelling ability which the 
student uses when he is writing, thinks ofa word 
and must recall how to spell it rather than se- 
lect it by recognition. It is true that he mayre- 
call several ways to spell and misspell the word 
and then make a selection from recognition, but 
still recall plays the major role. 

When dictation-write-in spelling ability was 
used as the criterion, a multiple correlation 








analysis revealed that the multiple-choice type 
of spelling makes a high contribution to the var- 
iance of the criterion. The contribution, 64.3 
percent, is not so high, however, as to exclude 
the contributions which other factors might make 
to the criterion. Two factors, Tonal Memory 
and Pitch, were found to make additional inde- 
pendent contributions. 

When the multiple-choice spelling variable 
was in its turn used as a sub-criterion, it was 
found that the ‘‘L’’ or linguistic score on the 
ACE would account for 34.2 percent of its vari- 
ance. The ‘‘Q’’ or quantitative score, however, 
made a negative contribution to the variance 
when the ‘‘L’’ score was held constant. Further, 
Spelling-M:C variance accounted for could not 
be increased by the addition of the particular el- 
ements of auditory images under investigation 
in this group. 

If one assumes that the functioning of intelli- 
gence as usually defined is facilitated by basic 
abilities in allied areas and also that the func- 
tioning of these allied basic abilities may be fa- 
cilitated by intelligence as usually defined, then 
one may postulate a mutual-reciprocation-of- 
cause-and-effect reaction between the two fac- 
tors. Once this hypothesis is tenable, part of 
the relationship which intelligence as usually 
defined has to spelling may be explicable in 
terms of the allied basic abilities. The hypoth- 
esis was tested: Part of the ‘‘L’’ or linguistic 
intelligence variable as it functions to make for 
individual differences in spelling can be ac- 
counted for by individual differences in ability 
to discriminate in some of the elements of aud- 
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itory images. The substrata analysis indicatec 
that both intensity and pitch exert such a func- 
tional influence on the verbal or ‘‘L’’ score. 

The major hypothesis: that the elements of 
the auditory image play a role in accounting for 
individual differences in spelling ability, there- 
fore, is substantiated at the university level as 
well as at the high school level. 


D. The Substrata Analysis of the Second Uni- 
versity Group 


Table VII presents the six intercorrelations, 
means, and standard deviations for the 102 stud- 


ents which constitute the Second University Group. 


In the light of results obtained on the High School 
Group and on the First University Group, two 
questions naturally arise: (1) How would phon- 
etics correlate with spelling at the university 
level? (2) What part of success in the Phonetic 
Association Test can be attributed to the Lingu- 
istic Intelligence Test Score? 

Inspection of Table VII reveals that the zero- 
order r between Spelling-M:C ability and ‘‘L’’- 
type intelligence is .509; between Spelling-M:C 
and Phonetic Association the r is .637. The in- 
terrelationship between ‘‘Q’* and ‘‘L’’ intelli- 
gence is expressed by an r of . 420, consider- 
ably lower than the Q-L intercorrelation found 
on the 1949 version of the ACE used on the First 
University Group. 


1, First Order Factors Underlying Spelling-M:C 
Ability 


Solution of the multiple correlation problem 
gives Phonetic Association and ‘‘L’’ intelligence 
as the first and second tests selected as making 
independent contributions to the criterion Spell- 
ing-M:C. The multiple ‘‘R’’ rises from .637 to 
.675 when ‘‘L”’ is added to Phonetic Association. 
Solution of the beta equations gives the following 
contributions which these variables make to the 
variance of Spelling-M:C: 





32. 5% 
13.5% 
54. O% 


2. Second Order Factors Underlying Spelling- 
M:C Ability 


A substrata analysis of Phonetic Associations 
on the second order of magnitude reveals further 
that the ‘‘L’’-type Intelligence will account for 
22.7 percent of the phonetic association score. 
Thus, a flow-sheet diagramming of the analysis 
of Spelling Ability for the Second University 
Group would appear like the diagram at the top 
of the next page. 


Phonetic Associations 
‘*L’’-type Intelligence 
Unaccounted for 
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3. Summary of Statistical Analysis on Second 














University Group 





The analysis of the Second University Group 
may be briefly summarized by answering the 
two questions posed in the opening paragraph in 
Section D. First, phonetic ability does play an 
important part in the spelling ability of univer- 
sity students, though not quite so much as it 
plays in the spelling ability of high school stud- 
ents. Second, the ‘‘L’’-type intelligence makes 
only a 13.5 percent contribution directly and a 
7.4 percent contribution indirectly through phon- 
etics to Spelling-M:C ability. Therefore, an 
appreciable amount of the variance not account- 
ed for in the primary analysis may be accounted 
for by elements of auditory images. Likewise, 
analysis of the phonetic variable in relation to 
the other group indicates that after the ‘‘L’’- 
variable has been taken out, the elements of 
auditory images still may function to make siz-~- 
able contributions to spelling ability. Finally, 
the ‘‘Q’’-score makes no contribution to Spell- 
ing-M:C ability when the ‘‘L’’ is held constant. 


SECTION IV 
SUMMARY AND CONCLUSIONS 
A. Summary 


1. Hypothesis: Individual differences in spel- 
ing ability may be accounted for not only by in- 
dividual differences in intelligence and vis ual- 
word-form-discrimination, but also by some 
of the elements fundamental to auditory images. 
The unknown part which kinaesthetic images 
play in spelling ability is recognized but is not 
under investigation at this time. 

2. Purpose: The hypothesis substantiated, 
the experiment aims at isolating those elements 
of auditory images which make detectable con- 
tributions to the variance of spelling ability at 
the high school and university levels. 

3. Populations: A sample of 227 students 
was drawn at random from English and Social 
Science classes ina large urban high school to 
form the High School Group. Two samples of 
91 and 102 students were drawn at random from 
the writer’s Educational Psychology classes to 
form the First and Second University Groups. 

4. Variables: In various combinations ac- 
cording to the sample being tested, the follow- 
ing variables were investigated: dictation- 
write-in type of Spelling-W:P ability, 5-choice 
multiple-choice type of Spelling-M:C ability, 
age, phonetic association ability, quantitative 
or Q-type intelligence, linguistic or L-type in- 
telligence, tonal memory, quality, intensity, 
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tonal movement, time, rhythm, pitch, melodic 
taste, and consonance or harmony. Most of the 
variables were assessed on two different instru- 
ments but with some overlap from sample to 
sample in accordance with the experimental de- 
sign. 

5. Method: A substrata multiple correlation 
analysis was made on the intercorrelation ma - 
trices obtained on all three samples. The sub- 
Strata analysis allowed the elements which in- 
fluence spelling ability to be precipitated from 
the matrices in accordance with the depth from 
which they function. 

6-A. Results: For the High School Group 
the test-factors which underlie Spelling-M:C 
ability on the primary level are phonetic associ- 
ations and tonal movement. When phonetic as- 
sociations were used as the sub-criterion onthe 
secondary level, the test-factors tonal move - 
ment, pitch, and intensity were found to make 
independent contributions. When tonal move - 
ment was used as the sub-criterion on the 
secondary andtertiary level, the test-factors 
which underlie it were tonal memory, pitch, 
rhythm, and melodic taste. 

When the contributions of elements are pro- 
rated through the sub-criteria subsumed within 
the major criterion, Spelling-M:C, the organi- 
zation of the variables with their percent con- 
tributions to spelling is evident. Figure 1 pre- 
sents this organization. 

6-B. Results: For the First University Group 
the test-factors found to underlie dictation-write- 
in type of Spelling-W:P ability on the primary 
level are Spelling-M:C, tonal memory, and 
pitch. Two factors (with their variance) were 
found to underlie the sub-criterion Spelling-M:C. 
The ‘‘L’’-score of the ACE Intelligence test con- 
tributed 34,2 percent. The ‘‘Q’’-score added a 
negative contribution to the spelling variance 
which amounted to -3.7 percent! None of the 
elements of auditory images investigated could 
be precipitated out at the secondary level. When 
the ‘‘L’’-score was used as the sub-criterion on 





the tertiary level, it was found that two of the 
elements of auditory images could be consider- 
ed to be fundamental components of the ‘‘L’’- 
score. These elements are Intensity and Pitch. 
A theoretical discussion is given to justify the 
writer’s position and hypothesis when he asks 
that psychologists and teachers recognize the 
fact that other basic-abilities which convention 
does not include as constituting a part of the 
realm of intelligence, personality, or of cultur- 
al differences may also play a role—not only in 
behavior to life situations, but also in the con- 
ventional intelligence test score. This hypoth- 
esis developed, the data and arguments are sub- 
mitted for the reader’s consideration. 

Figure 2 presents for the First University 
Group the organization of the substrata elements 
when their contributions to the variance of Spel- 
ling-W:P have been pro-rated through the sub- 
criteria subsumed within the major criterion. 

Accumulating the contributions then, a total 
of 11.2 percent of the Spelling-W:P variance 
may be attributed to elements of auditory images, 
at the university level. Tonal Memory, Pitch, 
and Intensity are the significant contributors. 
While nearly 20 percent of the variance of spel- 
ling may be accounted for at the high school lev- 
el by the elements of auditory images, only a 
little more than a tenth may be so accounted for 
at the college level. This is true in spite of the 
fact that the criterion used in the two samples 
should have favored a greater utilization of auc- 
itory images at the college level than at the high 
school level. We must conclude, therefore, 
that as the students become older, more select, 
and are exposed to a greater amount of educa- 
tion, they become more adept in the use of vis- 
ual-word-form images so that the auditory ele- 
ments are not depended upon to the extent that 
they once were. The possibility is present, 
however, that academic survival is on the basis 
of visual-word-form abilities and those who 
start with a predominantly auditory trend must 
change or run the risk of not being selected as 
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one who is apt to fit into our visually-dominant 
educational program! 

6-C. Results: For the Second University 
Group the factors found to underlie the recog- 
nition type of Spelling-M:C ability are phonetic 
associations and the ‘‘L’’-type intelligence. On 
the secondary level, ‘‘L’’-type intelligence con- 
tributed 22.7 percent of the variance to phonetic 
associations. Neither in the primary nor sec- 
ondary analysis did the ‘‘Q’’-type intelligence 
make a significant independent contribution. 
Therefore, the negative contribution found inthe 
First University Group can, perhaps, be dis- 
counted as an expression arising from chance 
fluctuations from sample to sample; however, 
it must be remembered that the ‘‘L’’-factor was 
tested on a different edition of the ACE Test in 
the Second University Group. 


B. Conclusions and Suggestions 


Indicated limitations preclude sweeping gen- 
eralizations which might go beyond the popula- 
tions sampled; however, a few conclusions seem 
warranted: 


1. Spelling ability at the high school and uni- 
versity level depends to a large extent upon abil- 
ity to handle phonetic associations. 

2. Both spelling ability and phonetic ability 
are dependent to some extent upon the ‘‘L’’ or 
linguistic type of intelligence. 

3. The ‘‘Q”’ or quantitative type of intelligence 
test score makes no contribution to ability to 
spell when the ‘‘L’’-type of intelligence is held 
constant, realizing, of course, that some ‘‘Q”’ 
is probably incorporated in the ‘‘L’’-score. 

4. Some of the elements of auditory images 
make an independent contribution to spelling a- 
bility at both educational levels even after phon- 
etic ability and ‘‘L’’-type intelligence are held 
constant. 

5. The elements of auditory images which 
appear to make contributions to spelling ability 
éither directly or indirectly are tonal movement, 





tonal memory, pitch, intensity, rhythm, and 
melodic taste. Together they account for nearly 
20 percent of the variance in spelling at the high 
school level and about 10 percent at the college 
level. 

6. For the educator, the inference would | 
seem to be that training in at least the listed ele- 
ments of auditory images might be a fruitful ave- | 
nue by which to attack the problem of teaching 
spelling readiness, especially to remedial cases | 
which have failed to learn by the usual visual- 
word-form method of teaching. 

7. The major inference growing out of the 


study is that the functional efficiency of ‘‘L’’- 
score abilities is in part dependent upon ele- 
ments of auditory images. 
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C. Suggestions for Future Research 


Now that the fact is established that there ex- 
ists a definite relationship between certain ele- 
ments of auditory images and spelling ability, 
it remains for future research to determine 
whether or not teaching for improvement inthese 
elements will improve a student’s ability inthem, 
and consequently improve his spelling. Further, 
new tests should be devised to probe for other 
auditory elements which might bear a relation 
to spelling ability. 

Several hypotheses have grown out of this 
study. Those which might warrant further in- 
vestigations follow: 


mportant to reading 
reading, both silent 


1. Auditory images are 
ability, especially speed <i 
and oral. 

2. Auditory images play a greater role in 
determining spelling ability at the elementary 
school level than they do at either the high 
school or university level. 

3. When the ‘‘L’’-type or verbal intelligence 
is held constant, the relationship between spel- 
ling and the ‘‘Q’’-type intelligence will be either 
zero or negative. 

4. Success in conventional intelligence tests 
as well as specific school subjects depends not 
only upon ‘‘G’’, primary mental abilities, per- 
sonality factors, and cultural background, but 
also upon such other basic abilities as those 
which might be considered fundamental elements 
in visual (46), kinaesthetic (31), and auditory 
images. 
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ANNOTATED BIBLIOGRAPHY OF PUBLICA- 
TIONS RELATED TO TEACHER 
EVALUATION 


WILLIAM A. WATTERS 
Chicago Public Schools 


THIS BIBLIOGRAPHY, relating toteach- 
er evaluation, came about as one phase of work 
of the Committee on Rating in the Chicago Pub- 
lic Schools. Charged with the responsibility for 
revising and improving the procedures of teach- 
er and principal evaluation in the school system, 
the Committee has in two years of activity, sur- 
veyed and studied the literature of researchand 
the philosophical approaches in the aims and ob- 
jectives of school personnel evaluation. Such in- 
vestigation was fundamental to the development 
of the new instruments and procedures now in 
experimental use in connection with the evalua- 
tion of a large sample of teachers and principals. 

It is felt that basic to a professionally accept- 
able evaluation plan is wide participation of school 
staff in the development and improvement of meth- 
ods and instruments. The Committee itself is 
composed of a cross-section of school person- 


nel from teachers to assistant superintendents. 


Questionnaire techniques have been and are be- 
ing continuously used to determine the needs and 
attitudes of the large number of individuals, who, 
for obvious practical reasons, cannot participate 
as members of the Committee. It is as an as- 
pect of the participatory process that this list 
of annotations will be of value if the easier loca- 
tion of pertinent source material is made pos- 
sible for persons busy with other important ed- 
ucational activities. 

In terms of function, it was desirable that 
the bibliography be extensive in the sense that 
it cover all material directly related to teacher 
evaluation; it was not necessary that it be so ex- 
tensive as to cover all publications having a 
bearing on related topics. For example, many 
articles on the merit-type salary issue contain 
information pertinent to teacher evaluation, and 
these are included, even though the merit-type 











salary philosophy has been rejected by the Com- 
mittee. On the other hand, articles focused on 

salary schedule problems not relating to teach- 

er evaluation are not included, nor are publica- 
tions in the field of teacher competency unrelat- 
ed to evaluation. 

As to the span of years to be covered, the 
publication in 1950 of a comprehensive bibliog- 
raphy of teacher competence by Domas and Tied- 
eman** made it unnecessary to include articles 
published prior to May of 1949, the last month 
covered in that work, which contains complete 
listings in the area of teacher evaluation. Ac- 
tually, all articles appearing during 1949 were 
checked for inclusion in that bibliography, and 
only those not covered by Domas and Tiedeman 
are included in the list to follow. An effort was 
made to investigate and annotate all relevant 
articles from that time through March, 1953. 


The annotations do not attempt value judg- 
ments; the practice was to present as objective- 
ly as possible either the substantive content in 
brief, or a few remarks as to the nature of that 
content. There are some instances where lim- 
itation of library facilities (and time and distance) 
made impractical the annotations. Inthese cases 
the listing is given and the item is marked with 
an asterisk. 


It is hoped that this bibliography will be 
an efficient aid and a positive contribution to the 
cooperative effort to improve teacher evaluation. 
The recommended use will of course be only in 
conjunction with the Domas and Tiedeman work, 
for there is no implication that all the pertinent 
work has appeared since 1949. The Index and 
Classification of Annotations following the Bibli- 
ography should provide an efficient means of lo- 
cating the desired material quickly. 


* A Project of the Committee on Rating, Chicago Public Schools, 1953. 


#*Simeon J. Domas, and David V. Tiedeman, "Teacher Competence: An Annotated Bibliography," Journal of 
Experimental Education, XIX (December 1950), pp. 99-218. Reference 29 in this bibliography. 
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BIBLIOGRAPHY 


Barr, Arvil S. ‘‘Measurement of Teaching 
Efficiency, ’’ in Growing Pvints in Educa- 
tional Research, official report of the Amer- 
ican Educational Researc}; Association, a 
department of the Nationa. Education Asso- 
ciation, 1949. Pp. 251-59, 

This is a review of the subject, making 
these points: (1) Evaluation of teachers 
was, is, and always will se carried on. It 
is incumbent on us to improve the process. 
(2) Confusing rating with «valuation is un- 
fortunate because rating i» only one method 
and not a good one. The trend is towarda 
multiple approach, applying more than one 
type of data, more than oie type of data 
gathering device, and mo;e than one evalu- 
ator. (3) The solution of many problems in 
education awaits the deve)»pment of adequate 
means of teacher evaluation. 

Four approaches in teacher evaluation 
are surveyed: (1) Evaluation of performance, 
observance of behavior; (2) evaluation of 
personal qualities, inferred from behavior 
or paper and pencil tests. (3) evaluation of 
mental prerequisites—k:wwledge, skills, 
interests, attitudes, etc. ; that seem to lie 
back of and to control persormance; (4) eval- 
ucation of pupil growth ari achievement. 

There is a review of the recent research, 
and a concluding section dealing with sug- 
gestions regarding needed research. 





Barr, Arvil S. ‘‘Merit Pay for Teachers?’’ 
Phi Delta Kappan, XXXI (September 1949), 
pp. 5-7. 

Discussion of the need of evaluation and 
the traditional difficulties encountered. The 
current trend is toward a multiple approach 
involving more than one person, methodand 
instrument. A review of the four approaches 
(see previous reference). Outlines three 
types of data gathering devices; (1) Tests for 
pupils and teachers; (2) rating scales, check 
lists, and other criteria of teacher effect- 
iveness, and (3) inventories. 

Suggestion of a ‘‘Master Teacher’’ cate- 
gory open to (1) only those who have shown 
themselves to be superior teachers, (2) only 
those who have through training and exper- 
ience acquired an adequate maturity to pro- 
vide the desired leadership, and (3) only 
those who have demonstrated interests that 
transcend their own individual assignments 
and who have shown special aptitudes in 
helping others. The categories of Appren- 
tice and Journeyman are also suggested; the 
designation Master should not go for unusual 
qualification in any one of these criteria, but 
to adequacy in all. 








3. 


4. 


5. 


Three important questions are posed: 

(1) Shall there be merit pay increases 
within these categories 

(2) How finely can these differences be 
drawn using the now available tech- 
niques ? 

(3) What ultimate social and educational 
values will be derived from such dif- 
ferentations ? 

The answer to the first question is a 
tentative yes, but dependent on the answer 
to the third question and for this ‘‘we need 
more data.’’ The answer to the second 
question is that we are able to differentiate 
only within broad categories. 


Barr, Arvil S. ‘‘Teaching Competencies, ”’ 
Encyclopedia of Educational Research, Re- 
vised Edition 1950. New York: Macmillan 
Co., 1950. Pp. 1446-54. 

In defining teacher efficiency, the wider 
inclusive role of the teacher is considered: 
The teacher as (a) a director of learning, 
(b) as a friend and counselor of pupils, (c) 
a member of a group of professional work- 
ers, and (d) a citizen participating in var- 
ious community activities. Three approach- 
es to teacher efficiency are suggested: (1) 
Definitions based on estimates of traits as- 
sumed to function in the teaching act, such 
as drive, considerateness, emotional sta- 
bility, intelligence, etc., (2) definitions 
based on appraisal of activities included in 
teaching, such as discovering and defining 
pupil needs, setting goals, stimulating in- 
terest, etc., and (3) definitions derived 
from measures of pupil growth. There is 
a review of the pertinent research. 





Barr, A. S. ‘‘Why Merit Rating Doesn’t 
Work, ’’ American Teacher, XXXVI (March 
1952), p. 24. 

Although listed in the Education Index 
under Barr, this article is not by Barr, 
but is an item in the ‘‘Education News Di- 
gest’’ column of the American Teacher. 
Several quotations from Barr’s works, not 
necessarily in context, are given. 











Barr, ArvilS. ‘‘Measurement of Teacher 
Characteristics and Prediction of Teaching 
Efficiency, ’’ Review of Educational Research, 
XXII (June 1952), pp. 169-74 

A review of recent research in relating 
characteristics to teaching efficiency, in- 
cluding teacher-pupil relations, teacher 
personality, qualities basic to teaching suc- 
cess, prediction of teaching success, and 
miscellaneous studies. A discussion of the 
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criteria of teaching effectiveness and need- 
ed research. Followed by a careful bibliog- 
raphy of research in this field. 


6. Barr, Arvil S. and others. ‘‘Report of the 
Committee on the Criteria of Teacher Ef- 
fectiveness, ’’ Review of Educational Re- 
search, XXII (June 1952), pp. 238-63. 

An involved discussion of the c o m plex 
conceptual framework in which the Com - 
mittee orients the research problem. In 
submitting this report, the Committee rec- 
ommends that clearance be given for spec- 
ific and varied research activities. (There 
is also a minority report signed by one man.) 





7. Beecher, Dwight E. ‘‘Objections Answered 
—The New York Plan of Rewarding Good 
Teaching, ’’ American School Board Jour- 
nal, CXIX (October 1949), pp. 35-7. 

Taking up fifteen specific quotations 
from an article by Spaulding (American 
School Board Journal, July 1949) the writer 
criticizes and answers each. Seven posi- 
tive values of the 1947 New York salary law 
are listed and developed. 








8.*Beecher, Dwight E. Evaluation of Teaching 
New York: Syracuse University Press, 
1949. 





9. Beecher, Dwight E. ‘‘Judging the Effective- 
ness of Teaching, ’’ National Association of 
Secondary School Principals Bulletin, XXxX- 
IV (December 1950), pp. 270-81. 

A paper on teacher evaluation structured 
around two aspects: (1) Basic Concepts in 
the Evaluation of Teaching, and (2) Apply- 
ing the Basic Principles’of Evaluation. ‘‘A 
thorough evaluation of teaching is an essen- 
tial and basic function of supervision. Such 
evaluation should be viewed by teachers, 
supervisors, and administrators as a con- 
structive, cooperative guidance procedure 
aimed at the improvement of instruction. 
Orientation to this concept may best be a- 
chieved through active teacher participation 
in planning and executing the evaluation pro- 
gram. Teacher fear of imposed ratings may 
best be dispelled through the mutual confidence 
provided by such participation. The evalu- 
ation of teachers should be continuous rather 
than periodic; it should be purposeful and 
the findings should be used for diagnosis of 
strengths and weaknesses in conference with 
the teacher... .If the appraisal is to be valid 
the criteria used must correspond to the 
basic objectives of teaching in the school; 
only those criteria involving desirable pu- 
pil change, or practices and behaviors ac- 
cepted as promoting such change, will pro- 
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duce valid results. The diagnosis onwhich 
evaluation is based must include a compre- 
hensive analysis of services rendered, with 
adequate, objectively observed evidence of 
performance.... When teaching is judged 
in accordance with these two sets of prin- 
ciples, we may expect increased confidence 
on the part of teachers in those responsible 
for such judgments, ”’ 


10. Beecher, Dwight E. ‘‘An Evaluation of the 
Attempts of Local School Systems in New 
York State to Include Competence Measures 
in the Salary Schedules, ’’ Harvard Educa- 
tional Review, XXII, No. 2 (Spring 1952), 
pp. 132-40. 

‘How the New York Salary Law of 1947 
was received, and how it affected the edu- 
cation of youth and the teaching profession 
onthe local or community level is described, 
The rather remarkable feature of a salary 
law designed and planned without democrat- 
ic participation, but proposing, neverthe- 
less, a great amount of democratic partic- 
ipation in local communities in the carry- 
ing out of its provisions, is developed. The 
author believes that a great part of what 
unfavorable reaction came to the law was 
due to the interference of the time element, 
which prevented teacher and local partici- 
pation in the formulation of the provisions 
of the law. 





11.*Beecher, Dwight E., and Bump, Janet W. 
The Evaluation of Teaching in New York 
State; Standards and Procedures Recom- 
mended by Local Advisory Committees. 
Albany: New York State Department of Fd- 
ucation, 1950. 57 pp. 











12. Best, Leonard E. ‘‘Incentive Pay for Bet- 
ter Teaching, '’ School Executive, LXIX 
(May 1950), pp. 43-4. 

‘*A school board member looks at the 
problem of recognizing teacher excellence 
by paying extra for exceptionally meritor- 
ious service, ’’ 

‘*Some people say that you cannot evalu- 
ate teachers; therefore, you should pay 
more for teachers with greater educational 
training.... If we pay on the basis of a col- 
lege degree, we really shift the responsi-~ 
bility from the administrator in our schools 
to the professor in the teacher training col- 
lege. If this evasion of responsibility 
reaches its ultimate extreme, we should 
refuse to pass on initial teacher selection. . 
.. Any teacher selection must involve an 
evaluation of fitness for the job, even though 
we have no means of seeing teachers in ac- 
tion unless we visit them at their schools... 
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We might just as well ignore the three 
year preliminary period of tenure if, atthe 
end of three years we are unable to differ- 
entiate between the teaching capacity and 
performances of various teachers. Any 
election to go on tenure involves careful 
evaluation. We must continue to eva luate 
teachers from the time they sign the orig- 
inal contract until they leave the system... 
We should also provide a definite incentive 
to all teachers to do their best.’’ Other 
arguments in favor of a merit salary. 


13. Better Than Rating. Association for Cur- 
riculum Development, Commission on 
Teacher Evaluation, National Education As- 
sociation, 80 pp. 

A statement of the issues involved in 
teacher rating, the relationship between 
evaluation and professional growth, and the 
effect on the total school program. The 
‘‘better way’’ is an outline of a planfor a 
‘‘comprehensive program of educational ap- 
praisal, ’’ as distinct from mechanical rat- 
ing devices. (1) The process is a cooper- 
ative enterprise involving pupils, school 
people, and lay citizens; (2) the program of 
appraisal starts ‘‘where the teachers are 
and goes on from there. ’’ ‘‘Individuals will 
not be singled out and marked either for un- 
deserved ‘success’ or equally undeserved 
failure.’’ Throughcooperative planning, the 
school community will find means whereby 
every individual, whether teacher, princi- 
pal, supervisor, or pupil, will literally dis- 
cover that he has an essential part in tb» 
on-going program. (3) ‘‘Evaiuation must 
be an integral part of the school commun- 
ity’s program for improving the education- 
al process, never an end product or im- 
posed by administrative order. ’’ (4) The 
program of appraisal is continuous andcom- 
prehensive. Techniques of appraisal must 
be flexible. (5) Methods and procedure for 
evaluating teacher services must be coop- 
eratively and locally evolved, since objec- 
tives set by one group will not be exactly 
Similar to those set by any other group. 
Arbitrary choice of a ready-made scale or 
plan for measuring or ranking teachers, 
principals, or pupils, is not necessary or 
possible in situations which encourage free- 
dom of choice. (6) Techniques must be de- 
veloped for gathering evidence of individual 
growth and development. (7) An evaluative 
process makes intelligent use of objective 
testing instruments which are available or 
can be constructed. 





14. Brandt, W. J. ‘Follow-Up of Some Earlier 
Wisconsin Studies of Teaching Ability, ”’ 
Journal of Experimental Education, XVII 











15. 


16. 


(Vol. XXII 


(September 1949), pp. 1-29. 

This is a follow-up of the studies made 
by LaDuke in 1945, Rostker in 1945, Jones 
in 1946, and Lins in 1946, under the guid- 
ance of A. S. Barr. This study found co- 
efficients of correlation for various meas- 
ures of teaching ability (rating forms) for 
reliability, and also comparisons with var- 
ious measures of pupil progress. The con- 
cern here is mostly with finding means of 
predicting teacher success, 


Brodsky, Charles. ‘‘The ‘Spark’ inGood 
Teaching, ’’ Clearing House, XXIV (Septem- 
ber 1949), pp. 41-2. (Editor’s Note: Mr. 
Brodsky calls it ‘spark’. You can’t always 
recognize it in the teacher himself... . Yet 

it appears over and over again in the clas- 
ses of every teacher who makes education 

a genuine treat for his students.) 

An eighteen point check-list, mostly 
concerning the atmosphere of the classroom, 
such as; Do you really have fun in theclass- 
room? Is there so much work going on, so 
vital to the youngsters, that they can’t help 
but talk excitedly to each other from time 
to time, even while you’re trying to get 
them quiet? 

‘*Let’s see who are the teachers with 
that ‘spark’, They’re all kinds—young, 
middle-aged, and old, They’re fat andthin. 
They’re teachers who carry extra jobsafter 
school hours, and those who go home to re- 
lax and prepare for the next day’s work. ”’ 
This teacher may be in any field. ‘‘He may 
or may not be active in teacher’s profes- 
sional organizations. This texcher may be 
married or single. Nor are the personal- 
ities of these teachers the same. The mas- 
ter teacher may be the one who pours on 
the charm and floods the classroom with 
words, or he may be the more quiet type. ° 





’ 


Brown, Sara Ann. ‘‘Technique for Evaluat- 
ing the Ability of Teachers to Apply Princi- 
ples Concerned with the Development Needs 
of Adolescent Girls, ’’ Journal of Education- 
al Psychology, XLI (December 1950), pp. 
481-7. 

An abstract of a thesis in which the au- 
thor investigated the efficiency of paper and 
pencil tests to measure ability of teachers 
to apply principles concerned with develop- 
mental needs of adolescents. In conclusion: 
‘It can be reasonably assumed that the abil- 
ity of individuals to apply principles canbe 
measured by X, and X, (two of the tests). 
These tests should make it unnecessary, for 
teacher educators to expend time, energy, 
and money in visiting widely distributed 
schools for the purpose of observing teach- 
ers in their classrooms. ’’ Other teacher 
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efficiencies were not studied. Teachers and Their Evaluation of Objec- 
tionable Pupil Behavior, ’’ Journal of Edu- 
17. Burke, Arvid J. ‘‘Organized Teachers and cational Research, XLV (September 1951), 
Public Policy on Teachers’ Salaries, ’’ Har- pp. 61-6. 
vard Educational Review, XXII (Spring 19- Some types of pupil behavior are more 
52), pp. 150-2. annoying to teachers with good mental health 
Begins with a discussion of the factors than to those with poor mental health, while 
that have limited the economic effective- other types of pupil behavior annoy the teach- 
ness of teacher organizations, and a 10 point ers with poor mental health more and those 
program of ‘‘positive’’ action for organized with good mental health less. Details of 
teachers. (Note: The author appears to be the research upon which this statement is 
discussing ‘‘education’’ associations, and based, 
not ‘‘teachers unions’’.) In regard to merit 
salaries: ‘‘Who can judge better... (than _| 22. Cook, William A. ‘‘Merit Rating and Salary 
teachers themselves)... if their effective- Increase, ’’ American School Board Journal, 
ness is increased or decreased by policies CXXIV (June 1952), pp. 33-4. 
which involve fear, conformity, rating by A strong defense of the principle of re- 
supervisors, and insecurity, or by policies warding teacher merit by paying salary in- 
which engender self-confidence, freedom, crements, There is a list of four items in- 
help and guidance from superiors, and se- volved in the price teachers pay for not 
curtiy?...* having merit rating, and also a list of five 
things the author says the denial of merit 
18. Burke, Arvid J. ‘‘Quality of Teaching Ser- rating is doing to ourselves. 
vice and Salary Policy, ’’ New York State 
Education, XXXIX (May 1952), pp. 610-11. 23. Cooke, Dennis H. ‘‘Should the Teacher Be 
A brief statement of the viewpoint of Paid for Tenure?’’ Phi Delta Kappan, XXXI 
‘‘Organized teachers”’ on salary policy rel- (March 1950), pp. 302-4. 
ative to merit, summarized in ten ‘‘general- Payment of teachers on the basis of years 
izations. ’’ One of these states: ‘‘It is prob- of service is questioned. (This is what is 
able that praise, understanding, sympathy, meant by being ‘‘paid for tenure’’,) ‘‘It has 
helpfulness, and encouragement which re- been my observation that for the most part, 
sult in hope, happiness, and self-confidence tenure protects the weak and ineffective 
will promote maximum growth and effect- teacher and professor. The competent, con- 
iveness ina teaching staff. If rating and scientious, and hard-working ones do not 
evaluation destroy this relationship between need it.’’ Suggests paying teachers ona 
teachers and the administrative or super- salary schedule based about 90% on educa- 
visory staff, the results may be lower equal- tion and years of service, and 10% interms 
ity of service. ’’ of tests of students, tests of teachers, su-_ 
* pervisory ratings, etc. Then as we attain — 
19.*Burke, John E. ‘‘What Makes a Good Teach- more knowledge and better techniques of 
er?’’ Educational Forum, XVI (January, evaluating teachers, the percentage or 
1952), pp. 205-9. weighting assigned to the teacher’s rating 
could be increased accordingly. 























20. Chamberlain, Leo M., and Kindred, Leslie 
W. Teacher and School Organization, Sec- 24. Cooke, Paul and Ware, Richard, ‘‘Remov- 
ond Edition. New York: Prentice-Hall, ing the ‘Hurdles’ from the Salary Schedule 
1949, pp. 308-17. in Washington, D.C.,’’ American Teacher, 

In Chapter X, ‘‘Working With Supervis- XXXVII (December 1952), pp. 6-9. 
ors,’’ the author discusses the appraisal A review of the efforts of the American 
of teaching under three types: (1) the meth- Federation of Teachers to change the 1947 
od of personal estimate, or subjective judg- salary schedule law in Washington, D.C., 
ment; (2) the teacher rating scale or score eliminating the ‘‘hurdles’’ which made the 
card; and (3) the evaluation of pupil prog- schedule in reality a merit-salary one. The 
ress. The rating scale is ‘‘unquestionably hurdles were subsequently removed in 1951. 
of larger importance in... (a supervisory) The attitude of the American Federation of 
...Capacity. It makes its greatest contri- Teachers toward merit-salaries is present* 
bution as a check-list and not as a scoring ed. 
instrument, ”’ 








25. Coss, Joe G. ‘‘Downey Develops Criteria 
21. Clark, Elmer J. ‘‘Relationship Between the for Superior Teachers, ’’ AmericanSchool 
Personality Traits of Elementary School Board Journal, CXXI (October 1950), p. 74. 
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The author is the District Superintendent 
of Schools in Downey, California, and inthe 
article describes the experience of a com- 
mittee of teachers and administrators to 
evolve criteria of the ‘‘superior’’ teacher. 
The criteria were used in evaluating proba- 
tionary teachers to be given tenure, and 
were worked out in the following areas: I 
Philosophy; 0 Skills and Techniques; III At- 
titudes; and [IV Personal Qualifications. 


26.*Davis, A. H. ‘‘Student, Your Customer, ”’ 


California Teachers Association Journal, 
II (February 1953), p. 10. 





27. Domas, Simeon J. Report of an Exploratory 





Study of Teacher Competence. Cambridge, 
Mass.: New England School Development 
Council, 1950. 

Report of a study conducted under the 
joint sponsorship of the Educational Research 
Corporationand the Harvard Graduate School 
of Education. The approach chosen was an 
application of the ‘‘critical incidents’’ tech- 
nique. In this technique, incidents are col- 
lected by asking respondents, teachers and 
administrators, to think of outstanding ex- 
amples from actual experience of teacher 
competence and teacher incompetence, and 
to relate enough of the cases so that the be- 
havior which makes the case one of out - 
standing competence or of incompetence can 
be identified. Incidents were collected 
mostly through group interviews, and, in 
all, 558 incidents of effective behavior, and 
443 incidents of ineffective behavior were 
collected. Descriptions of the respondents 
and of the incidents is carefully documented. 
Numerous schemes for classification of the 
incidents were tried, but no classification 
so far used resulted in a list short enough 
for practical use, yet complete enough to 
be defensible as to validity. There is data 
here for further research, and some sug- 
gestions along this line are supplied. 





28. Domas Simeon J. ‘‘Report of An Exploratory 


Study of Teacher Competence, ’’ American 
Business Education, VIII (May 1952), pp. 
305-7. 

A brief description of the study described 
in reference 27. 





29. Domas, Simeon J., and Tiedeman, David V. 


‘*Teacher Competence: An Annotated Bibli- 
ography, ’’ Journal of Experimental Educa- 
tion, XIX (December 1950), pp. 99-218. 
Listing of over 1000 articles, books, pam- 
phiets, etc., on all aspects of teacher com- 
petence, most of which are annotated. Clas- 
sification table makes location of desired 
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articles convenient. It covers publications 
up through the first half of 1949. This pres- 
ent bibliography, while limited to teacher 
evaluation and closely related subjects, does 
not repeat any of the Domas and Tiedeman 
listings. It begins where, in point of time, 
they left off. 


Douglass, Harl R., and Mills, Hubert H. 
Teaching in High School. New York: Ron- 
ald Press Co., 1948. Pp. 568-89. 

Aspects of teacher evaluation, self-eval- 
uation, and pupil appraisal. Personaltraits 
may be listed as teachers themselves see 
them, as pupils or administrators see them. 
A self-appraisal list of over forty charac- 
teristics is presented (questions which the 
teacher may ask of himself), to be marked 
on a five-point scale. Also discussion of 
teacher-community relationships. 





Evans, Kathleen M. ‘‘A Critical Survey of 
Methods of Assessing Teaching Ability, ’’ 
British Journal of Educational Psychology, 
XXI (June 1951), pp. 89-95. 

Four criteria of teaching ability are ex- 
amined: Pupil gain in information, the op- 
inion of experts, ratings on various rating 
scales, and the opinions of pupils. None of 
these is found entirely satisfactory, though 
the opinion of experts is at present the most 
suitable for general use. The available ev- 
idence suggests that there is little agree- 
ment between assessments made using dif- 
ferent criteria, but very few studies onthis 
subject have been reported. Probably the 
best criterion of any teacher’s worth would 
be a composite measure based onpupil’s 
gain in information, ratings by competent 
observers, and ratings based on the opin- 
ion of pupils. Having regard to the varia-~ 
tion in a teacher’s performance when con- 
ditions are varied, any such assessment 
should include a statement of the type of 
pupils, of the size of the class, and of the 
subject matter being taught when it was 
made. The following statements are made 
as arguments against the criterion of pupil 
change in measuring teacher efficiency: 

(1) The principle is simple; the application 
has proved less simple. In 30 years no 
suitable criterion of pupil change has e- 
merged. (2) There is need to measure not 
only knowledge gained, but changes in at- 
titudes, ideals, purpose, and personality. 
(3) The safeguard that groups are compar- 
able and that differences measured are ; 
statistically significant are not enough; 
pupils mature, but do not mature at the 
same rate. (4) Sandiford is quoted to the 
effect that changes may be due to good 
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33. 


34. 


35. 


teaching and thorough grounding at earlier 
Stages. (5) Changes noted may be due to 
habits of accuracy and industry inculcated 
by earlier teachers, or by parents and 
others outside the school. (6) There is 
question whether the ability to ‘‘get results’’ 
is good teaching. For example, cramming 
and other cases of information learned and 
quickly forgotten. 


Farmer, Paul. ‘‘Exam for Teachers of Eng- 

lish, ’’ National Education Association Jour- 

nal, XLII (February 1953), p. 81. 
Self-appraisal for English Teachers. 

Tén questions for the English teacher to 

ask of his own performance. 





Flanagan, John C. Critical Requirements 
for Research Personnel. Pittsburgh: Amer- 
ican Institute for Research, 1949. 

Description of the ‘‘critical incidents’’ 
technique, used later in studies of teacher 
competence. 








Franzen, Carl G. F. ‘‘What Supervisory 
Practices Promote Teacher Growth and Co- 
operation?’’ National Association of Second- 
ary School Principals Journal, XXXVI (Ap- 
ril 1952), pp. 17-26. 

One of the supervisory practices described 
is the use of ‘improvement sheets’’ designed 
to help the improvement of teacher service 
in specific areas or subjects. 








Gage, N. L., and Orleans, Jacob S. ‘‘Guid- 
ing Principles in the Study of Teacher Ef- 
fectiveness, ’’ Journal of Teacher Education, 
Ill (December 1952), pp. 294-8. 

A frame of reierence for research is 
presented: 1. Research should be concern- 
ed with teacher effectiveness rather than 
with over-all effect of all the factors in the 
teaching situation (not curriculum, instruc- 
tional materials, etc.,), but does consider 
all influences of teacher. 2. Concerned 
with general conceptions of effectiveness 
rather than with particular conceptions to 
suit special purposes. (Not selection, de- 
termining merit-salary increments, etc. ) 
3. Concerned, at least initially, with con- 
ceptual analysis of the research job; later 
(probably beginning now) more attention 
should be given to details of implementation. 
4. It is beyond the province of the present 
research committee to formulate ends of 
education; therefore, concern is with the 
effective teacher, rather than with the good 
teacher. 

A set of guiding principles for research 
is offered, and a conclusion that many de- 
tailed studies will be necessary and that 
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36. Gage, Nathaniel L. and Suci, 


37. 


38. Gragg, William L. 


39. 


caution in terminology is necessary. 


George. ‘‘So- 
cial Perception and Teacher Pupil Relation- 
ships, ’’ Journal of Educational Psychology, 
XLII (March 1952), pp. 144-52. Data from 
No. 5. 

Review of a research in which some a- 
greement was found between student ratings 
of teachers and social perception scores 
which were a comparison of teachers’ in- 
terpretation of pupil attitudes and pupil at- 
titudes as revealed by a questionnaire. 





Gans, Roma. ‘‘How Evaluate Teachers ?’’ 
Educational Leadership, VIII (November 
1950), pp. 77-81. 

A picture of the short-comings, needs, 
and possibilities for the future in teacher 
appraisal. Some encouraging signs are 
seen in the relationship between curricu- 
lum improvement (as a teacher-participa- 
tion activity) and teacher growth. Three 
avenues for future action: 1. Check, and 
whenever possible undo, practices that 
may be destructive of personality growth 
of teachers. 2. Continuation and further 
extension of curriculum studies in individ- 
ual schools, and on a system-wide basis, 
should be encouraged. 3. Research stud- 
ies planned cooperatively with leaders from 
other districts should be made. 





‘*Experiences With Mer- 
it-Salary Promotions, ’’ American Schooi 
Board Journal, CXIX (July 1949), pp. 23-5. 

Describes the 1947 New York salary 
law, and the process used in Ithaca to set 
up procedure. (Election of Committees, 
etc.) Committees drew up standards of ap- 
praisal, set up the administration of stand- 
ards. The evaluation score sheet used was 
a weighted rating card: 

A. Direct service to pupils 80 points 

B. Community Service s 

C. Personal Qualities (School, 

non-school) activities, and 
professional growth 10 "' 

D. Education a.” 
The law required that no more than 75% of 
those eligible need be promoted; of 173 
teachers, 33 were ‘‘eligible’’; all 33 were 
marked ‘‘exceptional’’, and all were there- 
fore given the increases. ‘‘The fact that 
the Board pursued a forward-looking policy 
of promotion was probably the greatest 
single factor in assuring a successful con- 
tinuance of the program. ’”’ 





Gragg, William L. ‘‘Ithaca’s Revised 
Teacher. Rating Plan, ’’ American School 








40. 
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Board Journal, CXXV (October 1952), pp. 
41-2. 

A follow-up of previous reference 38. 
The changes in procedure brought about by 
the action of a committee of teachers and 
administrators in view of the 1951 revision 
of the 1947 salary law. In the new plan, 
there is no numericai rating, but teachers 
are evaluated by principals through the use 
of an instrument containing the following 
main areas, with specific suggestions un- 
der each: I. Direct service to pupils; IL. 
Teaching Ability; II. Contribution of the 
teacher to the total school program; IV. Per- 
sonal Qualities of the Teacher; V. Profes- 
sional growth of the teacher. 

In the specific items under these main 
headings (not shown here) the teacher is 
marked Excellent, Good, or Fair, witha 
plus or minus for each, making nine classi- 
fications. For each of the main categories 
shown above, and for a total evaluation, the 
teacher is marked Excellent, Good, or Fair, 
with no plus or minus signs. (The 1951 re- 
vision of the law removed the requirements 
for merit~-salary increments. ) 





Grim, Paul R., and Hoyt, Cyril J. ‘‘Ap- 
praisal of Teaching Competency, ’’ Educa- 
tional Research Bulletin, XXXI, No. 4 (Ap- 
ril 1952), pp. 85-91. 

‘‘Our approach of ‘getting within the in- 
dividual’ in order to see just how he autis- 
tically views the world is the antithesis of 
taking at face value the belief that stimulus 
situations are much the same for all pupils 
.... This paper centers largely around the 
development of two new instruments for the 
evaluation of teaching competencies. One 
samples student’s feeling directly on a per- 
sonalized level. The other utilizes princi- 
pal’s ratings as criteria upon which to build 
the student’s instrument. The two instru- 
ments which we are developing are known 
as the student reaction inventory, and the 
teacher characteristic chart.’’ The study 
is only in formative stages, and no statis- 
tical findings are yet available. While the 
devising of the instruments has been to some 
extent an ‘‘armchair’’ process, it is hoped 
that empirical validation now in progress 
will provide evidence of the soundness of 
the rationale. 











Grotke, Earl M. ‘‘Professional Distance and 
Teacher Evaluation, '’ Phi Delta Kappan, 
XXXIV (January 1953), pp. 127-30. 

Two concepts are brought into education, 
adapted from the vocabulary of sociology. 
Professional Distance —defined as the fre- 
quency and divergency between points of 
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view heid by professional workers as to 
their role; Professional Role of the Good 
Teacher—the professionally determined be- 
havior expected or required of persons in 

a specific professional position, i.e., the 
position of the classroom teacher. The hy- 
pothesis presented here is that the lengths 
of professional distance would increase as 
ratings decrease from good to fairandfrom 
fair to poor. Since anevaluationofanother’s 
teaching is an expression of the difference 
between one’s ownconcept of another’s teach- 
ing and one’s concept of the professional 
role of the good teacher. The data did not 
warrant conclusions which would indicate 
that the situation was as clear-cut as the 
hypothesis stated, but there is evidence that 
the effect is involved in principal’s evalua- 
tions of teacher efficiency. 





. Hagman, Harlan L. The Administration of 





American Public Schools. New York: Mc- 
Graw-Hill Book Co., 1951, pp. 148-53; 
200-202. 

Chapter [IX ‘‘The Nature of Democratic 
Supervision, ’’ discusses ‘‘inspection and 
rating’’ as a ‘‘low order’’ of democratic su- 
pervision, as opposed to the ‘‘democratic 
social leadership’’ at the other end of the 
scale. ‘‘Rating scales can be used with 
benefit to instruction and may be employed 
on any level of supervision. Teachers and 
supervisors may welcome the rating scale 
as an inventory of teacher abilities and as 
a useful tool in the determination of the need 
for improvement. ... But when the rating 
scale is used in a supervisory program main- 
tained only on the level of inspection and rat- 
ing, the scale is often an instrument damag- 
ing to teacher morale....’’ 





. Hampton, Nellie Delight. ‘‘An Analysis of 


Supervisory Ratings of Elementary Teach- 
ers Graduated from Iowa State Teachers 
College, ’’ Journal of Experimenta! Educa- 
tion, XX (December 1951), pp. 179-215. 
This study had two stated purposes: (1) 
To find out what ratings can tell about a par- 
ticular group of Iowa State graduates; and 
(2) to obtain suggestions regarding rating 
schemes or systems in general. Related 
to the second purpose, there was an anal- 
ysis of ratings given at the same time using 
different instruments. Some conclusions: 
‘‘Correlations between success in trait rat- 
ings of the same persons were all different 
from zero at the one percent level, trait by 
trait, when the raters were the same, and 
nominally equal to zero when the raters 
were changed. ... The high correlations be- 
tween the trait ratings on the five point 
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scale and the general category rating seem approach described is that known as the 
to indicate that our individual trait ratings ‘‘critical incidents technique, ’’ (See Domas, 
actually are adding very little to our knowl- Simeon J. ‘‘Report of an Exploratory of 
edge of our teachers as a group which a Teacher Competence, ’’ ref. 28.) Critical 
general category rating could not supply. requirements are set forth under three cat- 
This does not mean that individual trait egories: Personal Qualities, Professiona! 
ratings may not be desired for diagnostic Qualities, and Social Qualities. Effective 
purposes, but for indications of general and ineffective examples are given under 
merit, one general rating may suffice. ’’ each, ‘‘It is suggested that the critical in- 
There are other conclusions. cidents technique might be employed prof- 
itably in local school situations in develop- 
44. Horrocks, John E., and Schoonover, Thelma ing valid bases for teacher evaluation, ana 
L. ‘‘Self-Evaluation as a Means of Growth as an aid to the in-service growth of teach- 
for Teachers in Service: Use of a Self-An- ers. ’”’ 
alysis Questionnaire, ’’ Educational Admin- 
istration and Supervision, XXXVI (Febru- 48. Kandel, I. L. ‘‘What is-Teaching Compe- 
ary 1950), pp. 83-9. tence ?’’ School and Society, LXXIII (May 
A general discussion of the difficulties 1951), pp. 315-16. 
and advantages of teacher evaluation leads A discussion of the implications of the 
to a statement that the benefits accruing to question related to the rights of parents, 
teachers from evaluation may be most ad- teacher's associations, Board of Education, 
vantageously gained through a process of and other groups in the dismissal of a tea- 
self-evaluation. Self-acceptance and coop- cher. The case in point was ina report of 
eration in devising the evaluative proced- the National Commission for the Defense 
ure are involved. This seems the optimum of Democracy Through Education. The au- 
approach from the standpoint of, (1) readi- thor is critical of the position taken in the 
ness, (2) self-acceptance, and (3) incentive report. 
for improvement. 











49. Kauffman, Grace I. ‘‘How Professional Ani 

45.*‘*How Do You Rate with Business ?’’ Grade I? A Self-Test, ’’ National Education Asso- 
Teacher, LXIX (April 1952), p. 76. ciation Journal, XAXIX (April 1950), p. 283. 

‘‘A Self-Test designed to emphasize the 

46. Jarecke, Walter H. ‘‘Evaluating Teaching positive. ’’ It has items grouped under six 
Success Through the Use of the T ea ching areas: Teacher~Pupil Relationships, Teach- 
Judgment Test, ’’ Journal of Educational er-Teacher Relationships, Teacher-Admin- 
Research, XL (May 1952), pp. 683-94. istrator Relationships, Teacher-Board of 

A report of a research project, the pur- Education Relationships, Teacher-Public 

pose of which was to design a test to evalu- Relationships, and Teacher-Professional 
ate some of the factors which contribute to Relationships. 
the success of teachers on the secondary , 
school level, in relation to their perform- 50. Lacy, Susan, Miller, John L., and Wardner, 
ance in the classroom, associations with Phillip. ‘‘Merit Rating: A Symposium, ’’ 
other teachers, and other aspects. Some Educational Leadership, [IX (October 1951), 
conclusions: Teacher experience seems to pp. 17-21. 
have a bearing on teacher success. Some A year after the Association for Super- 
unnamed factors, possibly ‘‘stability, ’’ af- vision and Curriculum Development pamph- 
fect teaching success. There seems to be let on rating was published (see reference 
a relationship between scholastic ability 13), three educators state their reactions 
and teaching success as measured by the to the viewpoint expressed therein. Susan 
Teaching Judgment Test. There are other Lacy makes a sympathetic case for the use- 
conclusions on about the same level of sig- fulness of the pamphlet, reviewing how 
nificance. ‘*Young Principal’’ finds it impossible to 

rate, and enlists the cooperation of the 

47. Jensen, Alfred C. ‘‘Determining Critical teachers in continuous evaluation. John L. 
Requirements for Teachers, ’’ Journal of Miller is critical of ‘‘Better Than Rating’’ 
Experimental Education, XX (September and asks for continuing study of the possi- 
1951), pp. 79-85. bility of relating salary and evaluation. 

‘‘This paper describes one of the ap- ‘*Moreover, to contend that rating of the 

proaches employed by the Teacher Char- teacher on tenure is impractical, and at 
acteristics Study in attempting to define the same time to stress the value of pre- 
criteria of teaching effectiveness.’’ The employment rating, is not consistent. ’’ 
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Phillip Wardner extolgi the timeliness and 
virtue of ‘‘Better Tha}: Rating. "’ 


Lamke, Tom Arthur] ‘‘Personality and 

Teaching Success,’’ Jfurnal of Experiment- 
al Education, XX (Deember 1951), pp. 217- 
59. 





The study sought t.janswer two questions: 
Are the personalities pf good and poor teach- 
ers, as evaluated by attell’s ‘‘16 Person- 
ality Factor Test’’ chiracteristically differ- 
ent? Are the personalities of goodand poor 
teachers, as evaluated by a paired compar- 
ison scale based on Cattell’s ‘‘20 Surface 
Traits’’ characterist:cally different? Re- 
sults were not very conclusive, but, for ex- 
ample, it ‘‘appears that good teachers are 
likely, more than poor teachers, to be gre- 
garious, adventurous, frivolous, to have 
abundant emotional responses, strong artis- 
tic or sentimental interests, to be interest- 
ed in the opposite sex, to be polished, fas- 
tidious and cool. Pour teachers are likely, 
more than good teachers, to be shy, cau- 
tious, conscientious, to lack e motional re- 
sponse, artistic or emotional interests, to 
have comparatively liszht interest in the op- 
posite sex, to be clumsy, easily pleased 
and more attentive to people. ’’ There is 
an implication ‘‘that good teachersare good 
for different reasons, and that poor teach- 
ers fail for varying reasons, ...It appears 
that success may be a ‘balance’. '* 





. Leeds, Carrol H. ‘‘A Scale for Measuring 


Teacher~Pupil Attitudes and Teacher~Pupil 
Rapport, '’ Psychological Monographs, LXIV 
(1950), pp. 1-24. 

A scale developed for measuring teacher- 
pupil attitudes correlated .43, .48, and .45, 
with principal’s ratings, observer’s ratings, 
and pupil’s ratings. (Data from Ref. 5.) 





Leeper, Robert R. ‘‘Fred Brown vs. the 
Elusive Ideal Teacher, '’ National Education 
Association Journal, XXXIX (December 
1950), pp. 672-4. 
A review of the philosophy and content 
of ‘‘Better Than Rating, '’ (see Ref. 13) in 
which are discussed the disadvantages of 
teacher rating plans: 
1. Teacher rating plans often fail to respect 
individual personality. 
2. Rating plans tend to encourage conformity 
rather than acting on thinking. 
3. Most rating plans fail to use cooperative 
social action. 
. Most plans lack qualities of cooperative 
evaluation 
a. Rating plans are an intermittent rather 
than a continuous form of evaluation, 
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and are directly or indirectly imposed 
from the outside, rather than devel- 
oped as an integral part of the learn- 
ing~teaching situation. 

. In most rating plans, evaluation is a 
consensus of people in status posi- 
tions, rather than a cooperative re- 
sponsibility of all persons affected by 
the process. 

. Plans often work to prevent, rather 
than to foster and guide, change in 
behavior. 

. When plans work for behavioral change 
the direction of change is imposed by 
the plan, rather than evolved cooper- 
atively by the group being evaluated. 

. Most plans leave little or no opportun- 
ity for intelligent selection and use of 
the best techniques for gaining evi- 
dence of behavioral change. 

A ‘‘better way’’ is indicated: The school 
community must organize in a voluntary co- 
operative manner to encourage professional 
growth. The school community must provide 
its teachers with rich opportunities for pro- 
fessional growth and development, and must 
give attention to several important person- 
nel practices. 


. Lindsey, Margaret. ‘‘Ask Yourself Some 


Questions, ’’ National Education Association 
Journal, XL (March 1951), pp. 173-5. 

A discussion of the criteria of the good 
teacher for self-evaluation. Are you happy? 
Are you social? Informed? Flexible? In- 
terested in children? Democratic? Proud 
of your profession? 





. Lodge, Evan. ‘‘Check Sheet— More Helpfor 


the New Teacher, ’’ Clearing House, XXV 
(May 1951), pp. 548-9. 

A description of a simple check sheet 
for the supervision personnel to use in con- 
nection with visitation. Only ‘‘best’’ things 
are found in the list to be checked. 





. McCall, William A. Measurement of Teach- 





er Merit, Publication No. 284. Raleigh, 
N.C.: North Carolina Department of Public 
Instruction, 1952. 40 pp. 

Report of a research in teacher-merit. 
The general plan was to measure compre- 
hensibly the growth produced in each class 
by the teacher of that class, to weight the 
elements of growth according to importance, 
to secure a single composite figure for all 
growths made by each class, to correct this 
weighted crude growth for capacity to grow 
and for differences in class size if the lat- 
ter appeared to influence growth, and then 
to correlate a large number of measures of 
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the teacher’s traits with this ‘‘purified’’ 
criterion of each teacher’s worth as a teach- 
er. Growth was measured by standardized 
tests in the following areas: General Mental 
Ability, General Education (including Citi- 
zenship, Forseeing Consequences, Under- 
standing the World, and Prejudice), Range 
of Knowledge and Experience, Social Behay- 
ior, Creative Composition, and Handwrit- 
ing. More thana score of old andnew meth- 
ods of evaluating teachers were compared 
with the pupil growth thus measured. None 
of them correlated high. Principal’s rat- 
ings correlated slightly negatively. Exper- 
ience showed little relationship. Training 
showed just a little more relationship (rough- 
ly, about 10% of the difference in teacher 
efficiency could de attributed to training). 
The best correlation of all was found to be 
confidential teacher self-ratings (plus 39% 
index of validity, corrected for attenuation 
to plus 59%). Also fairly high was pupil 
rating of their teachers ona social behav- 
ior scale. ‘‘All things considered, this 
study failed to find any system of measuring 
teacher’s merit which the writer is willing 
to recommend being adapted as the basis of 
paying the salaries of teachers. This study 
did establish. ...that the system of merit 


rating by official superiors....is of no val- 


ue...(p. 37).’’ ‘This whole study stands 
or falls on the acceptability. ...of the proved 
ability of the teacher to produce growth in 
pupils (as the criterion)... If the reader does 
not agree that this criterion is the chief and 
proper one, he will be unable to accept any 
of the conclusions of this research. ”’ 


57. McCartha, Carl W. ‘‘The Practice of Teach- 


er-Evaluation in the South-East in 1948, ’’ 
Journal of Educational Research, XLIV (Oc- 
tober 1950), pp. 122-8. 

Results of a study in which questionnaires 
were sent to city and county school adminis- 
tration units in ten southeastern states. Of 
778 replies received, 671 favored teacher 
evaluation, but only 170 (about 25%) were 
doing any evaluating. Other figures are giv- 
en and observations made. 





58. McGowan, W. N. ‘‘The Measure of a Suc- 


cessful Teacher, ’’ American School Board 
Journal, CXXI (July 1950), pp. 17-19. 

A re-evaluation of the qualities that mark 
a successful teacher in the light of progress 
made during recent years. ° 





59.*McNerney, Chester T. Educational Super- 





vision. New York: McGraw-Hill Book Co., 
1951, pp. 117-23. 
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60. Mazzei, Renato. ‘‘Desirable Traits of Suc- 


62. 


63. 


cessful Teachers, ’’ Journal of Teacher Ed- 
ucation, II (December 1951), pp. 291-4. 

An analysis of the traits approved and 
disapproved in their teachers by junior high 
school boys and girls. Similar tothe Witty 
“Quiz Kids’’ study. (See ref. 99.) 





. ‘**Merit’ Rating —What’s Wrong With It? 


New York’s AFT Members Give the Answer,’ 
American Teacher, XXXIII (April 1949), 
pp. 7-8. 

A summary of the reasons why the AFT 
opposes the basing of salaries on merit, 
from a letter from the Empire State Feder- 
ation of Teachers Unions protesting the en- 
dorsement of the 1947 New York Salary Law 
by the State Board of the American Associ- 
ation of University Women. Seven main 
reasons for the opposition of the AFT are 
described: (1) The school is not an industry 
and the products are intangibles whose last- 
ing effects may not be apparent until much 
later; they cannot be measured. Who is 
qualified to set monetary values on them ’ 
(2) The unreliability and lack of validity in 
rating; the influence of personal relations 
and bias. (3) Administrators lack time to 
make even subjective judgments, based on 
visits and observation. (4) The inevitabil- 
ity of a ‘‘popularity contest, ’’ with teachers 
being ‘‘yes-men’’ instead of cooperating and 
sometimes criticizing. (5) Do we want tea- 
chers or club-women? The teacher often 
has little time to join and participate in 
community organizations. (6) The unwork- 
ability, in experience, of merit-salary laws. 
(7) Teachers, supervisors, administrators 
and outstanding educators oppose it. 





Michael, William B., Herrold, Earle E., 
and Cryan, Eugene W. ‘‘Survey of Student- 
Teacher Relationships, '’ Journal of Educa- 
tional Research, XLIV (May 1951), pp. 657- 
73. 

It was found that boys and girls prefer 
teachers who allowed voluntary answers to 
questions to those who called on specific in- 
dividuals, and also prefer teachers who par- 
ticipate in extra-curricular activities. Other 
findings. 








Miller, Leo R. ‘‘Let Those Who Teach 
Rate for Merit, ’’ School Executive, LXVIII 
(May 1949), pp. 55-6. 

Proposes a rating system consisting of 
anonymous ratings made for each teacher 
by every other teacher. Such ratings would 
count for no less than the supervisory rat- 
ings made by the principal. There would 
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be no ratings by supervisors who visit only 
occasionally. A number of justifications 
are given for the plan, among which are: 
Teachers may be biased and prejudicial, but 
it is likely that 20 teachers will be fairer 
than one administrator; teachers would ben- 
efit from seeing what colleagues think of 
their services. (Data from ref. 5.) 


Milwaukee Public Schools, Office of the Su- 
perintendent. Report on Teacher Evaluation, 
Compiled by Harold 8. Vincent, Milwaukee 
Public Schools, April 1951, 8 pp. 

Brief report of a survey of teacher eval- 
uation practices in 22 large cities, a dis- 
cussion of the purposes of teacher evalua- 
tion, and recommendations for the Milwau- 
kee Public Schools. 





Misner, Paul J. ‘‘Teacher Rating is the Re- 
sponsibility of the Entire Profession, ’’ Na- 


tions Schools, XLVIII, No. 2 (August 1951), 
pp. 23-4. 

Starting out with a frank criticism of the 
A.S.C.D. pamphlet ‘‘Better Than Rating, ’’ 
the author reviews the need for evaluation 
and for relating salary to merit. A plan 
used successfully in Glencoe, Illinois, is 
explained. ‘‘Rating done exclusively by su- 
pervisors and administrators is a red her- 
ring employed by the commission (in ‘‘Better 
Than Rating’’) to confuse the issue and to 
discourage creative thinking and experimen- 
tation.... Teachers are being evaluated con- 
tinuously whether or not any planned pro- 
vision is made for evaluation. ... The devel- 
opment of salary schedule policies is inex- 
tricably reiated to the problem of evaluation. 
... It is inevitable that the achievement of 
better salaries for teachers will be accom- 
panied by a public demand for... . evidence 
that teachers are rendering continuing ef- 
fective and competent service. ’’ 


}. Morrison, J. Cayce, ‘‘History of New York 


67. 


State’s Approach to the Problems of Relat- 
ing Teacher's Salaries to the Quality of 
Teaching Service, ’’ Harvard Educational 
Review, XX (Spring 1952), pp. 124-32. 

Dr. Morrison sketches briefly the histor- 
ical background out of which the teacher's 
salary legislation of 1947 and 1951 develop- 
ed. He indicates the problems which con- 
fronted the several committees concerned 
with legislative recommendations, the solu- 
tions tentatively proposed, and the final rec- 
ommendations, The treatment is sympa- 
thetic to the New York plan of merit-salar- 


ies, 





Morrison, J. Cayce. ‘‘It’s Time to Adjust 
Salaries to Quality of Teaching, ’’ Nations 
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Schools, LI (February 1953), pp. 45-6. 

The case for salary related to merit 
against the background of the experience of 
New York with the salary law of 1947 re- 
vised in 1951. ‘‘Teachers themselves can 
and must make the chief contribution to de- 
veloping the theory and practice of evaluat- 
ing teaching. ’’ 


68. Morrison, J. Cayce, and Burke, Arvid J. 
‘‘Basing Salaries on Quality of Teaching. 
A Defense and a Criticism of New York’s 
Merit Law,’’ Nations Schools, XLIV, No. 
3 (September 1949), pp. 52-4. 

In this defense of the law, written by 
Morrison, and the criticism written by 
Burke, is a fairly complete description of 
the New York Salary Law of 1947, and also 
a development of arguments both for and 
against such rating of teacher to determine 
salary. 





69.*Mott, E. B. ‘‘Teacher Failures in the Pub- 
lic Schools,’ Agricultural Education Mag- 
azine, XXII (March 1950), pp. 208-9. 





70. National Education Association, Department 
of Classroom Teachers, and Research Di- 
vision. Teacher Rating, Discussion Pam- 
phlet No. 10. Washington, D.C.: National 
Education Association, April 1950, 24 pp. 

An informal discussion of the rating prob- 
lem. As to the reasons for rating: ‘‘Esti- 
mates of a teacher’s work are necessary 
for two purposes: As a basis for administra- 
tive decisions, and as a basis for improv- 
ing instruction. The ‘merit’ of a teacher 
is a guiding principle for each of these pur- 
poses.’’ On the criteria of good rating: ‘‘It 
should be objective, reliable, and valid, as 
a measure of teaching success or some im- 
portant aspect of teaching. ...Should be so 
administered as to minimize tensionandem- 
barrassment between rater and teacher 
which is almost bound to occur when one 
adult judges the work of another .’’ The fol- 
lowing are suggested as a basis for rating, 
with the recommendation that a composite 
basis is best: Pupil progress (several dis- 
advantages mentioned), methods of teach- 
ing, personality, mental attributes, contri- 
butions to school and community, and 
growth and development. The types of 
scales in common use are: Check list, guid- 
ed comment sheet, characterization report, 
descriptive report, and ranking report. As 
an alternative to rating, the use of the Cum- 
ulative Personnel Record is suggested. 
‘The collection of supporting evidence for 
rating opens the way to the use of a cumu- 
lative record. ’’ Such a file would contain 
evidence presented before employment, evi- 
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dence of work done, indications of prestige, 
personal growth. A table is presented with 
statistics relative to teachers’ opinions on 
rating. 


71. National Education Association, Research 
Division. ‘‘Teacher Personnel Procedures, 
1950-51: Employment Conditions inService,’’ 
Research Bulletin, XXX (April 1952), pp. 
33-64. See ‘‘Appraisal of Service, ’’ pp. 
48-9. 

Two tables are presented with a number 
of interesting and pertinent statistics on 
teacher evaluation. Cities are classified 
into groups, according to population, and 
the statistics presented for each group. 
Some of the items on which figures are giv- 
en: Number of cities rating various groups 
and classifications of employees, how many 
give copies of rating to the teachers, num- 
ber which use no ratings, types of rating 
scales in use, and the uses made of the rat- 


ings. 





72. National Education Association, Research 
Division and American Association of School 
Administrators. Promotion and Appraisal 
Procedures in City School Systems, 1950- 
51, Educational Research Circular No. 2, 








(February 1953), 28 pp. 

Contains two tables from questionnaire 
research data. One is concerned with Pro- 
cedures in Selection of Teachers for Pro- 
motion and the other with Methods and Pro- 
cedures of Appraisal. Much of this data is 
the same as that given in the previous ref- 
erence 71. 


73. Ojemann, Ralph H. ‘‘Identifying Effective 
Classroom Teachers, ’’ in Bases for Effec- 
tive Learning, Thirty-First Yearbook, De- 
partment of Elementary School Principals, 
National Education Association (September 
1952), pp. 130-8. 

An attempt to answer the question, ‘‘What 
kinds of teachers are effective in the class- 
room?’’ ‘‘We cannot locate the effective 
classroom teacher by taking into account 
only knowledge of subject matter taught, or 
interest in teaching. ...or any other single 
factor. The effective teacher, in the light 
of our present knowledge, has a combination 
of several factors....If we wish to locate 
the teacher who develops favorable attitudes 
in children, ...we should observe whether 
(he) is interested in working withthem, rather 
than in dominating them; whether he attempts 
to guide them by fear, ridicule, sarcasm, 
and partiality, or by a laissez-faire or in- 
consistent procedure. °’ 
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74. Orleans, Jacob S., and others. ‘Some 
Preliminary Thoughts on the Criteria of 
Teacher Effectiveness, '’ Journal of Educa- 
tional Research, XLV (May 1952), pp. 641- 
8. 

‘‘Perhaps a major weakness of education- 
al research has been the failure to do the 
basic thinking which is needed to insure that 
the right questions are being asked and that 
sound planning is being done. In dealing 
with a problem which is as abstruse and 
complex as that of teacher effectiveness, 
much time must be devoted at first to read- 
ing and to deliberations. The present paper 
summarizes the thinking done in this earlier 
stage.’’ The paper presents a comprehen- 
sive look into the difficulties which must be 
faced by workers in this field. The basic 
concept is that the ultimate criteria of teach- 
er effectiveness is change in pupil behavior; 
but that proximate criteria, or predictors 
of the ultimate criteria, may be found and 
identified. 














75.*Parent, N. J. ‘‘Evaluation of Good Teach- 
ing, ’’ Michigan Education Journal, XXX 
(October 1952), pp. 179-80. 





76. Pearman, W. I. ‘‘Toward a Supervisor- 
Teacher Partnership in the Evaluation of 
Teaching, ’’ High Points, XXXI (May 1949), 
pp. 22-30. 

The evaluation referred to is that which 
takes place when or after a supervisor visits 
a teacher. The partnership is in planning, 
carrying out and evaluating the observed 
teaching. 


77. ‘‘Policies Relating to Salaries for Teachers,’’ 
Journal of Teacher Education, If (June 1952), 
p. 113. 

A statement of policy adopted by the com- 

mission in 1952, which states minimums 
for experienced and inexperienced teachers, 
involves single salary standards based on 
preparation and experience and does not 
mention merit salaries. 





78. ‘‘Rating Probationary Teachers, ’’ American 
School Board Journal, CXIX (July 1949), pp. 
30. 

A new form for rating probationary teach- 
ers, worked out by a committee and pre- 
sented to the New York City Board of Super- 
intendents, to replace an obsolete scheme. 
Principals are asked to check the compet- 
encies of beginning teachers under five 
headings and to add recommendations for 
permanent appointment; (1) Personal and 
professional Qualities (8 sub-headings), (2) 
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Pupil Guidance and Instruction (10 sub-head- 
ings), (3) Classroom Management (4 sub- 
headings), (4) Participation in School and 
Community Activities (3 sub-headings), and 
(5) Principal’s Estimate of General Fitness 
(Additional Remarks). 


79.*Rechard, O. H. ‘‘Appraising and Rewarding 


Teacher Effectiveness, ’’ National Confer- 
ence on Higher Education Addresses, (1951) 
pp. 194-8. 








80. Reeder, Ward G. The Fundamentals of Pub- 


81. 





lic School Administration, Revised Edition. 
New York: Macmillan Co., 1951, Chapter 
IX, pp. 216-36. 

Discusses philosophy, need and methods 
of evaluation. Questions for discussion. 





Rogers, Dorothy. ‘‘Implications of Views 
Concerning the Typical School Teacher, ’’ 
Journal of Educational Sociology, XXIII 
(April 1950), pp. 482-7. 

Lists of twenty-one adjectives were giv- 
en to students and to teachers with instruc- 
tions to mark those most often used by the 
public to describe teachers. Inferencesare 
drawn from what students believe the public 
thinks of teachers, and from what teachers 
believe the public thinks of teachers. 





82. Ryans, DavidG. ‘‘The Criteria of Teaching 


83. Ryans, David G. ‘‘A Study of Criterion Data,’’ 


Effectiveness, ’’ Journal of Educational Re- 
search, XLII (May 1949), pp. 690-9. 

Out of the problems and experience relat- 
ing to the National Teachers Examinations, 
emerge a quest for criteria of teaching ef- 
fectiveness. ‘‘Teaching is effective to the 
extent that the teacher is able to provide 
ways and means that are favorable to the 
development of understandings, work habits, 
desirable attitudes, and adequate personal 
adjustment on the part of the pupils.’’ The 
criteria considered are (1) Ratings of teach- 
ers, and (2) measures of pupil change. Af- 
ter reviewing the difficulties, safeguards 
and lack of research relating to each, it is 
suggested that it is important to find sec- 
ondary criteria, or factors that reflect the 
basic criterion; those could be used as reli- 
able guides to teacher effectiveness. 





(‘A Factor Analysis of Teacher Behaviors in 
the Elementary School’’), Educational and 
Psychological Measurement, XII (Autumn 
1952), pp. 333-344. 

An answer was sought to the question: 
Should the statistical analysis of predictors 
(of teaching success) be carried out with re- 
gard to a single overall criterion, or should 
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the research proceed on the assumption 

that the criterion consists of several dimen- 
sions? By using trained observers working 
with a prepared form (the Classroom Obser- 
vation Scale), noting both teacher and pupil 
behavior, and applying factor analysis, it 
was indicated that the criterion did consist 
of several dimensions, and that these were 
associated for predictive purposes. Five 
factors emerged from the analysis: 

1. Factor A: Appears to be defined in 
terms of originality, adaptability and 
tolerance. 

. Factor B: A business-like, organized 
approach. 

. Factor C: Two clusters, (a) under- 
standing, kindly, fair approach, and 
(b) tendency to be composed, steady, 
easy-going. 

4. Factor D: Approachable, friendly, 
tactful, gregarious. 

5. Factor E: Related to superficial ap- 
pearance, as physique, voice, etc. 

‘*It is of interest to note that the pupil be- 
havior traits contribute significantly to fac- 
tors A and B, but that these traits have 
zero loadings on Factors C, D, and E. This 
may suggest that pupil behavior inclass 
may be, to a considerable extent, a func- 
tion of the teacher’s ability to (1) stimulate 
the pupils and (2) maintain effective class 
control, i.e., to maintain situations in which 
the pupils are alert and responsible andare 
participating in constructive activities. ’’ 
Another interesting fact brought out was 
with regard to the correlations between as- 
sessments of teachers by different observ- 
ers. These ‘‘ranged from 0. 68 to 0. 84 
when the assessments of all teachers obser- 
ved by the same observers were consider- 
ed.’’ This study is a part of a research 
subsidized by the Grant Foundationand spon- 
sored by the American Council on Educa- 
tion. It is an aspect of the work known as 
the Teacher Characteristics Study. 





Ryans, David G. ‘‘A Study of the Extent of 
Association of Certain Professional and 
Personal Data with Judged Effectiveness of 
Teacher Behavior, ’’ Journal of Experiment- 
al Education, XX (1951), pp. 67-77. 

A progress report on the work of the 
Teacher Characteristics Study, under the 





directorship of the author. Trained ob- 
servers judge the effectiveness of class- 
room teaching, and the data have been 
compared with the results of professional 
and personal inventories. 


Scates, Douglas E. ‘‘The Good Teacher: 
Establishing Criteria for Identification, "’ 





June, 1954) 


Journal of Teacher Education, I (June 1950), 
pp. 137-41. 

Discussion of the complexity involved in 
all attempts to develop criteria of teacher 
competence. ‘‘The defining of good teach- 
ing is not impossible; it is difficult because 
of the psychological subtleties and because 
of the interplay of many factors. It cannot 
be accomplished in terms of any single pat- 
tern of characteristics unless these are made 
very general.’’ ‘‘Through a careful balance 
between research studies and careful insight- 
ful thinking, we can expect to make progress 
even though this area may be difficult. ’’ 





. Schwartz, A. N. ‘‘A Study of the Discrim- 
inating Efficiency of Certain Tests of Pri- 
mary Source Personality Traits of Teach- 
ers,’’ Journal of Experimental Education, 
XIX (September 1950), pp. 63-93. 

The problem attached in this study was 
the predicting efficiency of certain person- 
ality tests as far as teaching success was 
concerned. These were measured against 
the criteria of marks, ratings in student 
teaching, and ratings in service. A few, 
but no very significant relationships were 
discovered between the tests and teaching 
success as measured by ratings. Thereare 
recommendations for further research. 





87. Shane, Harold G. ‘‘Seven Types of Teacher 
Appraisal, ’’ Nations Schools, L (July 1952), 
pp. 58-9. 

From a survey of ‘‘thirty-five outstanding 
school districts’’ in various parts of the 
United States, comes this digest of findings 





relating to teacher appraisal. Seven types 
of evaluation were in use and were reported 
in the following frequencies: 
Systems 
Rating Scale or Check-list 8 
Written reports following 
classroom visits 7 
No formal rating plan 15 
Self-appraisal form prepared 
by the teacher 10 
Verbal reports, principal to 
central offices 16 
Subjective appraisal by 
superintendent 10 
Group evaluations by teacher’s 
fellow workers 4 
There were 70 responses (above) from 35 
districts, so it is obvious that most systems 
used, on the average, at least two of these 
methods. Most of the administrators sam- 
pled felt that teachers should not be merit- 
rated to determine progress upward on the 
salary schedule, but in an apparently con- 
tradictory stand, five out of six superintend- 
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88. 


89. 


90. 


365 


ents felt that teachers should be dismissed 
when they were evaluated and found to be de- 
ficient in ability or personality. ‘‘This 
seems to be a common-sense attitude 
rather than an inconsistency. It is absolute- 
ly necessary in the interest of the children 
for the administrator to discharge persons 
who are ineffectual in the classroom, It is 
not, however, necessary to establish de - 
grees of excellence among capable teach- 
era. *” 


Simpson, Ray H., and others. ‘‘A Study of 
Resourcefulness in Attacking Professional 
Problems, ’’ School Review, LX (December 
1952), pp. 535-40. 

‘‘Resourcefulness’’ was measured by 
the number and quality of suggested solu- 
tions or responses to a hypothetical prob- 
lem situation ina classroom. It was found 
that certain groups of teachers classified 
according to grade levels and subjects taught 
were significantly different from others. 





Spalding, Willard B. ‘‘New York’s Unwise 
Plan of Recognizing Merit in Teacher’s 
Salaries, ’’ American School Board Journal, 
CXIX (July 1949), pp. 21-3. 

An argument against the principle of mer- 
it salaries, and a description of the ‘‘spec- 
ious’’ reasoning which, it is said, under- 
lies such attempts as the 1947 New York 
law. This article is in part a critical re- 
sponse to one by Francis T. Spaulding, in 
the Phi Beta Kappan of July 1947, explain- 
ing and praising the law. 








Symonds, Percival M. ‘‘Reflections on Ob- 
servations of Teachers, ’’ Journal of Educa- 
tional Research, LXIII (May 1950), pp. 688- 
96. 

The author observed 24 teachers prepar- 
atory to a study on the relation between the 
personality of the teacher, the mode of 
teaching, and the pupil response inthe class- 
room. Comments and insights resulting 
from those observations are presented, The 
variation and complexity of personalities 
was great and it appeared that there was no 
one ‘‘best’’ type of teacher. Almost all 
types of personalities were found among 
successful teachers, and the accepted be- 
lief that only normal, well adjusted persons 
should be teachers seemed not to hold, for 
some of the successful teachers observed 
were definitely neurotic and their neuroti- 
cism contributed to their success as teach- 
ers. There were some general character- 
istics of the successful teacher that seemed 
to cut across all the variations in person- 
ality. They were all more or less secure 
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and confident; they were interested and 
liked boys and girls, and they were able to 
accept them. Sincerity seemed an import- 
ant factor. Another interesting obser va- 
tion: ‘‘In general the school takes on the 
color and mood and atmosphere of those in 
administrative authority.’’ ‘‘So faras they 
can, the teachers will also play roles sim- 
ilar to those set by the principal as a pat- 
tern. The principal of a school sets the 
pace for the whole schoolteachers and 
pupils. ’’ 


‘*Teachers Ask End of Rating, ’’ Scholastic, 
LVIII (February 7, 1951), p. 5t. 


. ‘*Teacher’s Marks Abolished: New Zealand 
Plan, '’ Times Educational Supplement, No. 
1945 (August 8, 1952), pp. 667. 

That the old system of numerical grad- 
ing of teachers be abolished and be replaced 
by a system embodying promotion lists, was 
a recommendation reported inthis news 
article. Other information about the old 
and the proposed new planof teacher apprais- 
al in New Zealand. 





. Tiedeman, David V. ‘‘Pay for Teac hing,’’ 
Harvard Educational Review, XXII (Spring 
1952), pp. 97-112. 

Neither the ‘‘preparational’’ nor the ‘‘po- 
sitional’’ salary schedule accomplishes the 
objective of paying teachers for the profic- 
iency with which they educate children. 
There is a lack of evidence to support the 
conventional salary schedule. (The ‘‘prep- 
arational’’ type involves steps, usually years, 
of experience and degrees or other meas-, 
ures of preparation; the ‘‘positional’’ type 
refers to the kind of position: elementary, 
junior high, etc.) The usual arguments 
against merit salaries are criticized anda 
plan for the development of a merit-type 
salary schedule is proposed, involving: 1. 
joint effort of administrators, public, and 
teachers; 2. several levels of teaching effic- 
iency defined for each teaching position; 3. 
lower salaries made ample; 4. large incre- 
ments ($1500 for the first year, perhaps 
two or three more of $1000 each); 5. move- 
ment upward as rapidly as teacher warrants 
promotion. ‘‘The least convincing argument 
against the merit-type salary schedule is 
that we should continue to use our prepara- 
tional type salary schedules until someone 
else devises a scheme for measuring teach- 
ing proficiency which is reliable and valid. 
This latter restriction is inconsistent, since 
it is the validity of the preparational type 
salary schedule which must be proved, and 
not that of the merit type... .if the assump- 
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tions are accepted that the purpose of pay- 
ing teachers is to reward them for educat- 
ing children, and that the proficiency with 
which they do this is not the same for all 
teachers.... The most insidious argument 
against the merit-type salary schedule is 
that it destroys the morale of a school sys- 
tem.’’ Facts are listed, then ‘‘these argu- 
ments are indeed powerful ones. Certainly, 
if the solidity, mutual respect, and cooper- 
ativeness of a faculty is disintegrated be - 
cause of the adaption of a merit-type salary 
schedule, the plan should be discontinued.’’ 
Again, p. 108, ‘‘the proposal for the adap- 
tion of a merit-type salary schedule is not 
likely to come from teachers. ’’ 


. Tompkins, Ellsworth and Armstrong, W. 


Earl, ‘‘Teacher Ratings: Persistent Dilem- 
ma, ’’ National Association of Secondary 
School Principals Bulletin, XXXV (May 1951), 
pp. 25-31. 

In this review of the subject of teacher 
evaluation, the authors report impressions 
from a study of the literature: 1. There is 
a great deal of material printed, for, against, 
and in-between. 2. Earlier publications 
emphasize technique and manner, while of 
late there is more question raised as to the 
desirability of rating. 3. There is increas- 
ing mention of the complex factors involved. 
4. There is growing concern for the morale 
factor, the effect of rating on teachers. 5. 
Increasing tendency to recognize self-eval- 
uation and cooperative group evaluation as 
more productive of results. 6. There is 
still a great deal of bias and disagreement, 
not likely to decrease. 








. Trump, J. Lloyd. ‘‘Merit Rating Puts the 
Cart Before the Horse, ’’ Nations Schools, 
XLV (June 1950), pp. 51-3. 

Arguments for and against merit rating 
as they appear to the Board of Education 
member, the superintendent, the principal, 





and the teacher. When working conditions 
are considered in relation to the function of 
the teacher, it is seen that working condi- 
tions effect the efficiency of teaching. Var- 
ious phases of the ‘‘job of the teacher’’ are 
analyzed, and in each case it is demonstrat- 
ed that one of the important factors in effic- 
ient teaching is the condition under which the 
teaching is carried out. ‘‘It would seem de- 
sirable to seek first the correction of con- 
ditions under which teachers frequently 
work before placing emphasis on evalua- 
tion, ’’ 


Unzicker, Samuel P. ‘‘Ends and Means in 
Supervision, ’’ Educational Administration 
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and Supervision, XXXVI (November 1950), 
pp. 385-95, 

Supervision as a two-way process; dem- 
ocratic, non-authoritarian supervision. 
The second part of the article raises the 
question, ‘‘What part does appraisal, eval- 
uation, ‘rating’, have in this process?’’ 
‘One way for a teacher to be brought to ac- 
cept appraisal by another might be to help 
to plan the items in any rating form, or at 
least to fully accept their implications. ”’ 





97. Vander Werf, Lester. ‘‘The Trouble With 
Rating Systems, ’’ American School Board 
Journal, CXXV (August 1952), pp. 17-8. 

The author is scepticai of rating systems 
because they involve the following assump- 
tions ‘‘all partly or completely false. ’’ 

1. That teaching can be accurately meas- 
ured; 2. that administrators can be objec- 
tive in their judgments; 3. that individual 
competitive situations encourage competence 
and high morale; 4. that teaching staffs lie 
on the curve of normal distribution. Sug- 
gestion of a positive program of improve- 
ment of instruction rather than merit rating. 





98. West, Allan M. ‘‘The Case For and Against 
Merit Rating, ’’ School Executive, LXIX 
(June 1950), pp. 48-50. 
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A statement of both sides of the case, 
for and against merit-type salary schedules. 


99. Witty, Paul. ‘‘Some Characteristics of the 
Effective Teacher, ’’ Educational Adminis- 
tration and Supervision, XXXVI (April 
1950), pp. 193-208. 

Describes the results obtained from an 
analysis of 14, 000 letters sent in as entrees 
for an essay contest sponsored by the ‘‘Quiz 
Kids’’ radio show, on the topic ‘‘The Teach- 
er Who Has Helped Me the Most.’’ Twelve 
of the most often mentioned characteristics 
in the order of the frequency mentioned are: 

. Cooperative, democratic attitude 
. Kindness and considerateness 
. Patience 
. Wide interests 
. Pleasing personal appearance and 
manner 
. Fairness and impartiality 
. Sense of humor 
. Good disposition and consistent 
behavior 
. Interest in pupils’ problems 
. Flexibility 
. Use of recognition and praise 
12. Unusual proficiency in subject 
A list of a dozen negative characteristics, 
things which pupils do not like, is also pre- 
sented. 
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INTELLIGENCE LEVELS AND CORRESPOND- 
ING INTEREST AREA CHOICES OF NINTH 
GRADE PUPILS IN THIRTEEN 
MICHIGAN SCHOOLS 


KENT W. LEACH 
University of Michigan 


WHAT ARE the first choices of interest 
areas for pupils of higher intelligence levels as 
compared to selections made by pupils in the 
middle or lower intelligence groups? Numerous 
factors, including the types of tests used to meas- 
ure intelligence and interest as well as the age 
and grade level of the pupils tested, would influ- 
ence such choices. This article presents data 
derived from scores made by 779 ninth grade 
boys and girls from thirteen Michigan high 
schools on the New California Short-Form Test 
of Mental Maturity, Advanced, 1947, and the 
Kuder Preference Record, Vocational, Form CH. 
The data are presented in such a manner that 
the rea?’er can ascertain a pupil’s first choice 
of imverest area on the Kuder record and his cor- 
responding position on a five-group scale of in- 
telligence based on the California test scores. 

Table I shows that thirteen schools, all rela- 
tively small in enrollment, voluntarily partici- 
pated in this study. These schools sent in re- 
sults for both the New California Short-F orm 
Test of Mental Maturity, Advanced, 1947, and 
the Kuder Preference Record, Vocational, Form 
CH.! Using the Michigan High School Athletic 
Association system of classification, we see 
that no Class A schools took part in this study. 
Of the thirteen schools, two were Class B; eight, 
Class C; two, Class D; and one, Class E. Two 
of the schools are non-public; three are in met- 
ropolitan areas. 

Five intelligence levels or groups were se- 
lected arbitrarily by marking off division points 
on the Michigan profile sheet. This profile sheet 
depicts Michigan norms for the two tests usedin 
this survey. Table I shows the five groups with 
corresponding percentiles and raw scores for 
language, non-language, and total mental factors 
of the California test and similar raw scores for 
the Kuder record. The levels of intelligence in 
Table II show that group one represents the su- 
perior group; group two, the above-average 
group; group three, the average group; group 





four, the below-average group; and group five 
the lowest intelligence group. 

One tablulation sheet for each of the tenpref- 
erence areas was constructed, ‘T.a.le II is an 
illustration of such a sheet showing the boys’ 
data for the outdoor area. One can tell by ex- 
amining this table that in the non-language sec- 
tion, for example, in groupone, seven boys des- 
ignated the outdoor area as being the one of prime 
interest tothem. In the language sectionin group 
three, seventeen boys rated the outdoor area as 
the mostappealing of the teninterest areas. Table 
IV gives similar information for the girls. 

Another type of tabulation sheet was also need- 
ed. Table IV is an illustration of thisand shows 
how many pupils from a certain school listed a 
particular area as a first choice within each in- 
telligence group. 

By using the type of tabulation system as ex- 
plained in the foregoing paragraphs, summary 
sheets were constructed as illustrated by Tables 
V through X. For example, Table V lists the 
first choices of interest areas and correspond- 
ing intelligence group standings for 408 ninth 
grade girls from the thirteen Michigan schools. 

Examining Table V reveals that in the non- 
language section, of the girls who are inthe high- 
est intelligence group (Group I), twelve listed 
the artistic interest area as their first choice. 
In the language section, of the girls who are in 
the lowest intelligence group (Group V), four - 
teen chose as their first preference the clerical 
interest area. One can see, too, by examining 
the last row marked, ‘‘Total Number of Pupils,’’ 
that fifty girls listed the outdoor area as their 
first choice. Thus one can determine by exam- 
ining Table V how many girls of the 408 chose 
each interest area as a first choice, and how 
many girls of each of the five intelligence levels 
picked a particular interest area as a first 
choice. 

Interesting interpretations can be derived by 
examining these tables. In Table VII inthe non- 





1. Some schools administered the 1950 California test and the Kuder (BB) form. Others gave the 1950 Cale 
ifornia test and the Kuder (CH) form. The author is now in the process of collecting data for those 
schools administering the 1950 California test and the Kuder (CH) form. 


2. Class A, 800 or more pupils; Class B, 325-799; Class C, 125=32h; Class D, 75-12l; and Class E, less 


than 75. 
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TABLE I 


ENROLLMENTS OF SCHOOLS AND NUMBER OF NINTH 
GRADE PUPILS FROM THE THIRTEEN SCHOOLS 
PARTICIPATING IN THE STUDY OF INTELLI- 
GENCE AND INTEREST 





Number of Ninth Grade Pupils 
in Study 





Enrollment — 
School Grades 9-12 Boys Girls Total 


132 12 
62 

335 54 
119 

387 

185 

298 

302 

311 

283 

238 

172 

104 





l 
2 
3 
4 
5 
6 
7 
8 
9 
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TABLE ITI 


NUMBER OF PUPILS IN 13 MICHIGAN SCHOOLS SELECTING OUTDOOR INTEREST AREA 


OF KUDER PXEFERETICE ROCORD AS FIRST CHOICE, A'D GROUP STANDINGS ON CALI- 
FORNIA MENTAL MATURITY TEST FOR 53 NINTH GRADS BOYS 








1h? S-FORM TEST OF SCHOOLS SCHOOLS 


MENTAL MATURITY 
TOTAL NO. 


Groups in Terms of ; 
Rew Score Points I II | VIII} Ix XI} XII }XIII 9 or pyprrs 


GROUP I 
9 or more 1 1 ? 
GROUP ITI 
B= 33 3 9 
GROUP III 
32 - 35 
OROUP IV 
28 = 31 
GROUP V 
0 = 27 
TOTAL NUMBER 
OF PUPILS 


GROUP I 

or more 
GROUP ITI 
29 = 32 
GROUP III 
23 = 26 
GROUP IV 
20 = 
GROUP V 
O-1 
TOTAL NUMBER 
OF PUPILS 


5 
“< 
fe, 
a 
=< 
S 
4 
of 
2} 


LANGUAGE FACTORS 


GROUP I 
68 or more 
GROUP II 
63-6 
GROUP IIT 
- 62 
GROUP IV 
GROUP V 
0 - 8 
TOTAL NUMBER 
OF PUPILS 


TOTAL MENTAL FACTORS 








TABLE IV 


NUMBER OF PUPILS IN SCHOOL NO. 1 AND THEIR CORRESPONDING FIRST CHOICES OF 
INTEREST AREAS OF THE KUDER PREFERENCE RECORD, AND GROUP STANDINGS ON THE 
CALIFORNIA MENTAL MATURITY TEST FOR 12 NINTH GRADE GIRLS 


‘7? S-FORM TEST OF KUDER PREFERENCE RECORD = VOCATIONAL = FORM CH 


MENTAL MATURITY AL 
Groups in Terms of Mech- | Compu- Art- | Lit- Soc. | Cleri-#NO.OF 
Raw Points ani cj sive isti Serv cal PUPILS 


I 
or more 1 1 3 
5 


2 
5 
z 
ta 
= 
F 
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LANGUAGE FACTORS 


or more 
ROUP ITI 


III 
- 62 
UP IV 


V 


TOTAL MENTAL FACTORS 
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language section, 103 pupils of the 779 selected 
the outdoor interest area as their first choice. 
These 103 pupils are distributed through the in- 
telligence groups as follows: In group one, there 
are ten pupils; group two, twenty; group three, 
thirty-one; group four, twenty-three; and group 
five, nineteen. This grouping changed somewhat 
in the language area. For example, fifteen pu- 
pils fell into the first intelligence level; twelve 
pupils in group two; thirty in group three; sev- 
enteen in group four; and twenty-nine in group 
five. In the total mental factors section, fifteen 
pupils are in group one; thirteen ingroup two; 
thirty-three in group three; sixteen ingroup four; 
and twenty-six in group five. It can be seen, too, 
that of the pupils who picked the outdoor area as 
their first choice, more fall into the average in- 
telligence group and into the lowest group than 
into the other three levels. 

Table X depicts the same type of relationship 
expressed in percentage of pupils rather than in 
number of pupils. Of the 103 pupils who picked 
the outdoor area as the first choice, 32 percent 
are in group three on the total mental factors 
section. Many other interpretations can be glean- 
ed from an analysis of the data in Table X. For 
example, in the non-language area the highest 
percentage of pupils who selected the outdoor 
area are in the average intelligence group. The 
highest percentage selecting the mechanical in- 
terest area are in group one, the highest percent- 
age picking science, group three; the highest per- 
centage indicating the persuasive area, group 
three; and the highest percentage checking artis- 
tic, group one. 

Jn other words, those pupils who did the best 
on the non-language section of the California test 
checked the mechanical, computational, and ar- 
tistic interest areas as their most popular choices, 
while those who ranked in the highest group in 
the language area picked science and literature 
as the most popular areas. Only 9.1 percent of 
the non-language group falling in the fifth intelli- 
gence group picked science, whereas 22. 4 per- 
cent of those in the fifth group picked the persua- 
sive area. Only 7.3 percent falling in the low- 
est intelligence group on the language sectionof 
the test picked science, while 28.2 percent of 
those picking the outdoor area fell into the fifth 
intelligence group. A glance at the total mental 
factors section reveals that of the number of pu- 
pils choosing the computational interest area, 
the highest percentage is in group one. As far 
as the interest areas per se, they rank as fol- 
lows: 


103 pupils 
95 pupils 
91 pupils 
88 pupils 
85 pupils 


13. 2% 
12. 2% 
11. 7% 
11. 3% 
10. ¥% 


. Outdoor 
. Mechanical 
. Clerical 
. Artistic 
. Musical 
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74 pupils 
72 pupils 
67 pupils 
55 pupils 
49 pupils 


. Social Service 
. Computational 
. Literary 

. Science 

. Persuasive 


However, in order to ascertain which intelli- 
gence group is responsible for making a partic- 
ular interest area the popular area, an examin- 
ation should be made of Tables XI, XII, and XIII. 
Tables XI and XII are summaries for the girls 
and boys respectively; Table XIII is a combined 
summary. An example should be used at this 
time to facilitate an interpretation of Table XIII. 
As has been pointed out previously, the outdoor 
area ranks first in popularity considering the 
total number of pupils making choices. The 
highest percentage of those pupils actually choos- 
ing this area are in the middle intelligence group 
on the non-language, language, and total mental 
factors. An examination of Table XIII alsoshows 
that of the total number picking the computation- 
al area, the highest percentage on the non-lang- 
uage section fall in the highest intelligence group. 

The actual number of pupils in each intelli- 
gence group level is distributed among the sec- 
tions of the California test as follows: 


Language 


141 pupils 
124 pupils 
242 pupils 
114 pupils 
158 pupils 


Non- Language 


168 pupils 
133 pupils 
198 pupils 
154 pupils 
126 pupils 


Group 1 
Group 2 
Group 3 
Group 4 
Group 5 


Group 1 
Group 2 
Group 3 
Group 4 
Group 5 


Total Mental Factors 





166 pupils 
129 pupils 
238 pupils 
118 pupils 
128 pupils 


Group 1 
Group 2 
Group 3 
Group 4 
Group 5 


At first glance, one might say that since there 
are more pupils falling within the average intelli- 
gence groups, there will be, therefore, more 
pupils in each of the ten interest areas falling in 
group three. But there are exceptions. For 
example, Table VII reveals that most of the pu- 
pils choosing the mechanical, computational, and 
artistic areas on the non-language section are in 
the highest intelligence group; while in the lang- 
uage section, there are more pupils in group 
one who selected the science area. In the lang- 
uage section there are more pupils in the sec- 
ond intelligence group who picked the literary 
area with group one ranking second. For the 
outdoor area the number of pupils falling inthe 
very lowest level of intelligence on the language 
part had only one less pupil than the number fall- 

> 
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TABLE V 


FIRST CHOICES OF KUDER INTEREST AREAS AND GROUP STANDINGS ON THE CALIFORNIA 
MENTAL MATURITY TEST FOR 08 NINTH GRADE GIRLS FROM! 13 MICHIGAN SCHOOLS -- 
EXPRESSED IN TERMS OF NUMBER OF PUPILS 





'h? S-FORM TEST OF KUDER PREFERENCE RECORD = VOCATIONAL = FORM CH 


MENTAL MATURITY - 
Groups in Terms of Mech- |Compu- | Scien-| Persua-| Art- | Lit- | Mus-{Soc. 


Raw Score Points anicalj tationalj tific | sive istic] er ical|Serv. 








GROUP I 10 3 1 12 4 8] 6 
39 or more 
GROUP II 

% = 38 . 4 5 7 
GROUP IIT 

32 = 35 
GROUP IV 

28 - 31 
GROUP V 

0 = 27 
TOTAL NUMBER 
OF PUPILS 


GROUP I 

33 or more 
GROUP II 
29 = 32 
GROUP III 
23 - 28 
GROUP IV 
20 = 22 
GROUP V 
0-19 
TOTAL NUMBER 
OF PUPILS 


GROUP I 
68 or more 
GROUP II 
63 - 67 
GROUP III 
Su = 62 
GROUP IV 
9 - 53 
GROUP V 

0 - 48 
TOTAL NUMBER 
OF PUPILS 














NON-LANGUAGE FACTORS 




















LANGUAG: FACTORS 




















TOTAL MENTAL FACTORS 
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Wey CALIFOINTA 1 
14? S-FORM TEST OF KUDt PREFERENCE KECOKD < VOCATIONAL = FOR CH 
MENTAL MATURITY 

Groups in Terns of  Houtefitech- [Compu- | Scien-|Persua-|aArt- [Lit- 

saw Score roints oor jand tational] tific | sive istic 


SS = 
B:0uP 4 71 20 13 6 
10 


10 





FF PUPILS 
(OUP I 

3 or more 
(OUP II 

9 - 32 


3t0UPr III 
3 = 28 


WOUP IV 


4 > 


OUP V 
- 19 
ITAL 

F PUPILS 


RIBEN 


OTAL NUMBER 
F PUPILS 
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TABLE VII 


FIRST CHOICES OF KUDER INTEREST AREAS AND GROUP STANDINGS ON THE CALIFORNIA 
MENTAL MATURITY TEST FOR 779 NINTH GRADE BOYS AND GIRLS FROM 13 MICHIGAN 
SCHOOLS - EXPRESSED IN TERMS OF NUMBER OF PUPILS 





REY ChITFormTA AACE 


'h? S-FORM TEST OF KUDER PREFERENCE RECORD - VOCATIONAL = FORM CH 


MENTAL MATURITY 
Groups in Terms of Out-|Mech= | Compu- |5Scien-| Persua-j Art- ;Lit- jMus-jSoc. 


* 


Raw Score Points anicalj tational] tific | sive istic|erary jical|Serv. 


GROUP I 

39 or more 10 30 23 ly 28 ll | 19 10 
GROUP 

% « RY 20 13 13 8 12 ly | 15 13 


GROUP ITI 
32 = 35 31] 20 17 20 22 


GROUP IV 
28 = 31 
GROUP V 

0-277 19} 12 12 15 Us 
TOTAL NUMBER 
OF PUPILS 103 | 95 

















23 20 7 13 15 





NON-LANGUAGE FACTORS 





88 7h 





GROUP I 
33 or more 18 ly 17 


GROUP II 

29 = 32 ly 9 12 
GROUP IIT 

23 - 28 3h 23 
GROUP IV 

20 = 22 12 9 
GROUP V 

0-19 j 19 13 
TOTAL NUMBER 

OF PUPTLS 88 
GROUP I 

68 or more 20 
GROUP ITI 

63 = 67 16 
GROUP III 

Su - 62 
GROUP IV 

9 = 53 
GROUP V 

0 - 8 
TOTAL NUMBER 
OF PUPILS 














LANGUAGE FACTORS 























TOTAL MENTAL FACTORS 
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TABLE VIII 


FIRST CHOICES OF KUDER INTEREST AREAS AND GROUP STANDINGS ON THE CALIFORNIA 
MENTAL MATURITY TEST FOR 1,08 NINTH GRADE GIRLS FROM 13 MICHIGAN SCHOOLS <-- 
EXPRESSED It! TERMS OF PUORCENTAGE OF PUPILS 








WEW CALIFORNIA ADVANCED 
‘h7? S-FORY TEST OF KUDER PREFERENCE RECORD = VOCATIONAL = FORM CH 
“WTAL MATURITY 
Oroups in Terms of Mech=- [Comm- |Scien-| Persuaq Art- t= |Mus- fS5oc. 
Raw Score Points anical|tational/ tific | sive istic|erary] ical Serv. 


(PERCENTAGES) 























GROUP I 
39 or more 


GROUP II - 
% - 36 fel Qe ll.j 17.9 


2363 12.0 ? , cOot 10.3 











JROUP ITI 
32 = 35 
GROUP IV 

28 = 31 95 


GROUP V 
0 = 27 : 83 


UAGE FACTORS 


~ 
Vv 








NON-LAN 








GROUP I , 
33 or more ll. £ 63 
GROUP II 

29 = 32 De’ 17.61] $2 











3. 8 23 2305 || 125 


GROUP IV 

20 = 22 } $ 3 . 19.6 | 71 
GROUP V 

0 - 19 . om 2705 











GROUP I 

68 or more 5 . 7.8 
GROUP II 

63 - 67 
GROUP III 

Su = 62 
GROUP IV 

49 = 53 
GROUP V 

0 ~ 18 
TOTAL NUMBER 
OF PUPILS 

















TOTAL MENTAL FACTORS 
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TABLE IX 


FIRST CHOICES OF KUDER INTEREST AREAS AND GROUP STANDINGS ON THE CALIFORNIA 
MENTAL MATURITY TEST FOR 371 NINTH GRADE BOYS FROM 13 MICHIGAN SCHOOLS -- 
EXPRESSED IN TERMS OF PERCENTAGE OF PUPILS 





17 S-FORM TEST OF — KUDER PREFERENCE RECORD - VOCATIONAL = FORM CH 
MENTAL MATURITY 
tT 





Soc. [leri- 


Groups in Terms of Compu- |Scien-| Persua-|Art- | Lit- 
Serv. jcal 


Raw Score Points r tationaljtific | sive istic] erary jical 
PERCENTAGES) 








GROUP I 
39 or more L6 ols BHeT | 19k 3702] 25.0 [320k 30.0 


GROUP II 
x o 38 21k 13.3 19 lj 17.6 22.5 








GROUP III 
32 - 35 14.3 2303 | 2920 20.6 22.5 


GROUP IV 
28 « 31 Tel 16.7 16.1 14.7 15.0 








NON-LANGUAGE FACTORS 


GROUP V 
0 = 27 10.7 10.0 16.1 14.7 10.0 


(PER 
GROUP I 
33 or more ¥o7 20.6 


GROUP II 
29 = 32 20.0 5.9 


GROUP III 
23 - 28 
GROUP IV 
20 = 22 
GROUP V 
0-19 














LANGUAGE FACTORS 








GROUP I 
68 or more 
GROUP II 
63 - 67 
GROUP III 
Su - 62 
GROUP IV 
9 = 53 
GROUP V 

0 = 48 
TOTAL NUMBER 
OF PUPILS 














TOTAL MENTAL FACTORS 
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TABLE X 


FIRST CHOICES OF KUDER INTEREST AREAS AND GROUP STANDINGS ON THE CALIFORNIA 
MENTAL MATURITY TEST FOR 779 NINTH GRADE 30YS AND GIRLS FROM 13 MICHIGAN 
SCHOOLS - EXPRESSED IN TEUS OF PERCENTAGE OF PUPILS 








'h? S-FORM TEST OF KUDER PREFERENCE RECORD - VOCATIONAL - FORM CH 


MENTAL MATURITY 
Groups in Terms of Mech= |Compu- | Scien-|Persua-|Art- |Lit- |!fus-|Soc. [Cleri- ||NO. OF 
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(PERCENTAGES 
31.6 2565 14.3 31.3 16.5 2264 13.5 17.46 168 


SCHS. 
TOTAL 











GROUP I 

39 or more 
GRO 

% ot 13.7 W.5 14.3 1326 y 17.6 17.6 19.3 


GROUP III 
32 - 35 21.1 2703 | 28.6 2267 20.0} 29.7} 2765 








WAGE FACTORS 


~ 
u 





GROUP IV 
23 e 31 23-4 20-5 1.3 2305 20.3 20.9 


GROUP V 
9 o 27 Fel 22h 17.0 16.5 14.3 





NON=LAN 





(PER 
GROUP I 

33 or more ‘ 30.9 oe 16.5 
GROUP ITI 
29 = 32 
GROUP IIT 

23 - 26 5. 30.6 


uP IV 

ya 22 10.6 
GROUP V 

0-19 2he7 





20.0 f- 17 6 








NGUAGE FACTORS 
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oROUP I 

68 or more 

GROUP IT 

63 - 67 

GROUP III 

Sh = 62 

GROUP IV 

49 = 53 
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TABLE XI 


RANKS OF INTEREST AREAS AND CORRESPONDING INTELLIGENCE 
GROUPS FOR 408 NINTH GRADE GIRLS FROM 13 MICHIGAN SCHOOLS 





Intelligence Groups 





Interest Non-Language Language Total Mental 
Areas Factors Factors Factors 


bani I 
I IV 
I-IV Il 
Il Il 
Il Ill 
-Ill-IV-V (tie) pan Ill 
-IV (tie) I-III (tie) Il 

I ll 
-IV (tie) mm IV 
-IV (tie) Il I 


Pel 
ry 
a 





Musical 
Clerical 
Outdoor 
Artistic 
Computational 
Mechanical 
Social Service 
Literary 
Science 
Persuasive 


SCORNIAMSLwWe 
BESETE"BES 
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TABLE XIl 


RANKS OF INTEREST AREAS AND CORRESPONDING INTELLIGENCE 
GROUPS FOR 371 NINTH GRADE BOYS FROM 13 MICHIGAN SCHOOLS 





Intelligence Groups 





Interest Non-Language Language Total Mental 
Areas Factors Factors Factors 


Outdoor I Il IlI-IV (tie) 
Mechanical I ill I 

Artistic I Il Ill 
Clerical I I Il 
Musical I ul ti 

Social Service Il Il ul 
Persuasive I I 

Science I I 

Computational I I 

Literary Il ll 


Fy 
& 
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TABLE XIll 


RANKS OF INTEREST AREAS AND CORRESPONDING INTELLIGENCE GROUPS 
FOR 779 NINTH GRADE BOYS AND GIRLS FROM 13 MICHIGAN SCHOOLS 





Intelligence Groups 





Interest Non-Language Language Total Mental 
Areas Factors Factors Factors 





Outdoor i oti Wl 
Mechanical I ill mW 
Clerical Il 1 Il 
Artistic I i i 
Musical IV I Ill 

Social Service I Il ll 
Computational I Ill I 
Literary Il ll l-IL (tie) 
Science I I I 
Persuasive 1 I I 
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TABLE XIV 


IN] EREST AREAS IN RELATION TO INTELLIGENCE 
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Group V Group IV Group III Group IT Group I 


PERCENTILES-NEW CALIFORNIA MENTAL MATURITY TEST, ADVANCED, 197 S-FORM 
TOTAL MENTAL FACTORS 
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ing in the average group. 

It is interesting to plot the number of first 
choices of interest areas by pupils against the 
intelligence groups in which the choices were 
made. By so doing, we arrive at the graph in 
Table XIV. This table shows at each level of in- 
telligence the popularity ranking of the interest 
areas. In group one, the mechanical area is 
first; group two, literature and art are tied for 
first; group three, the outdoor area is first; 
group four, the clerical area was at the top; 
and in group five, the list is headed by the out- 
door area, 

The graph can also be read in this manner: 
Twenty-one pupils in group four signified that 
their first choice of interest area is clerical. In 
group two, nine of the pupils picked science as 
their first choice, althoughfifteen pupils picked 
the mechanical area in that same group. 

In summary, these conclusions merit atten- 
tion: 


1. In all intelligence groups, the persuasive 
interest ranks relatively low in popularity. 
2. In all intelligence groups, the sciencearea 
also ranks relatively low in popularity. 
. The social service area is relatively con- 
sistent as far as its standing in each ofthe 
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five intelligence groups. With the excep- 
tion of its place in the superior group where 
its rank is next to last, it is near the mid- 
dle of the rankings. 

. The outdoor area ranks highest in interest 
in the lowest and average intelligence 
groups and second in the below-average 
group. The highest intelligence group, 
however, places the outdoor area toward 
the middle of the list. 

. The computational area received its high- 
est position in the superior intelligence 
group. 

. Literature and art received their highest 
rankings in the above-average intelligence 
group. 

. The clerical area received first place in 
the below-average intelligence group and 
ranked well up the scale in the average as 
well as the lowest intelligence group. 


It is true that it is dangerous to draw such 
conclusions on the basis of limited data. Never- 
theless, it is rather interesting tosee such rela- 
tionships involving 779 ninth grade Kuder and 
California test scores. Additional data gathered 
undoubtedly will clarify the conclusions brought 
forth in this article. 





OUTCOMES OF LECTURE AND DISCUSSION 
PROCEDURES IN THREE COLLEGE 
COURSES 


HARRY RUJA 
San Diego State College 
San Diego, California 


SECTION I 
INTRODUCTION 


Statement of the Problem 





THE INVESTIGATION here reported 
has sought to measure and contrast some out- 
comes of lecture and discussion methods in col- 
lege teaching. Since the cultivationof emotional 
and social values as well as of intellectual val- 
ues has come to be included among the import- 
ant objectives of the schools, the present study 
has sought to assess these outcomes as well as 
the intellectual outcomes of the two methods. 


Definitions 


By ‘‘lecture’’ is meant continuous discourse 
by the instructor for purposes.of instruction. 
By ‘‘discussion’’ is meant interchange of ques- 
tion and answer among students primarily, with 
the instructor playing a role chiefly of moder- 
ator. The instructor roughly defines the area 
of discussion and supplies information when 
directly asked for it or when it illustrates a point 
already made or when it poses a question rele- 
vant to the topic under consideration—but only 
if this material is not readily available other- 
wise. Frequently, when he is asked a question, 
he will turn it back to the student who has asked 
it, or to other students in the class. Mostly the 
activity of the instructor consists in reflecting 
the content and feelings of students’ comments 
and questions, relating these to one another and 
to a central topic, and promoting orderly se- 
quences of discussion. He does not correct or 
confirm student judgments (or even misstate- 
ments of fact) but rather accepts and reflects 
them ina ‘‘nondirective’’ manner. For fuller 
descriptions of this procedure and point of view, 
see references 1, 3, 11, and 12 at end of this 
article. 





Design of the Experiment 





The design of the experiment was as follows: 


Fall, 1951-1952: 
Philosophy 1A (Introduction to Philosophy) 
lecture 
Philosophy 1B (Introduction to Philosophy) 
discussion 
Psychology 1 (General Psychology) discus- 
sion 


Spring, 1951-1952: 
Philosophy 1A, discussion 
Philosophy 1B, lecture 
Psychology 1, lecture 


Schedules of assignments and discussion- 
topics, prepared in advance of each semester 
and followed fairly faithfully, enabled the in- 
structor to devote about the same amount of time 
to a topic in both lecture and discussion sections 
of a givenclass. These schedules were distrib- 
uted (or, in the philosophy classes, dictated) to 
students at the first meeting. The sameassign- 
ments were made to both lecture and discussion 
sections, the same textual materials used, and 
the same examinations administered, The writ- 
er served as instructor in all the classes com- 
prising the experimental groups of the present 
study. The classes were part of the regular 
offering of San Diego State College, and stud- 
ents selected them ina manner no different from 
that in which they might enroll for any other 
such classes. The classes were not identified 
in any way as experimental classes; the instruc- 
tor did not announce to his students that the y 
were subjects in an experiment. 


Hypotheses 


The experiment may be thought of as seeking 
to assess the validity of four hypotheses; viz. , 








* This paper is an abridgment of the writer's umpublished Master's thesis, Outcomes of Lecture and Dis- 
cussion Procedures in College Teaching, San Diego State College, 1952. 





*#The writer expresses appreciation to Drs. Manfred H. Schrupp, Wolcott C. Treat, and Merle 5. Turner, 
all of San Diego State College, for guidance in the design, execution, ami reporting of the research 


reported here. 





386 JOURNAL OF EXPERIMENTAL EDUCATION 


students in discussion classes in comparison 
with students in lecture classes: 

a. Show greater subject-matter mastery, as 
measured by course examinations; 

b. Exhibit greater gains in emotional adjust- 
ment at the end of the semester, as meas- 
ured by an adjustment inventory; 

*, Express more favorable attitudes toward 
their instructor, as measured by an in- 
structor rating form; and 

. Become better acquainted with their fellow- 
students, as evidenced by knowledge of a 
greater number of names of fellow-stud- 
ents. 


SECTION I 
MEASURING INSTRUMENTS 
Examinations 


The examinations were all objective-type 
(multiple choice), consisting of from 32 to 94 
items. Four examinations were administered 
to each of the philosophy and five to each of the 
psychology classes, including a comprehensive 
final examination. The writer computed split- 
half coefficients of reliability for all examina- 
tions, correcting for length with the Spearman- 
Brown formula, They ranged from .56 to .91, 
for the most part increasing successively during 
the semester. 

Except for Philosophy 1B (where the textual 
material was somewhat scanty), the examina- 
tions covered only textual material. (The stud- 
ents were informed early in the semester that 
this would be the case.) The text for Psychology 
i was a just-published standard text in general 
psychology (9). The textual material in the phil- 
osophy classes consisted of mimeographed syl- 
labi prepared by the instructor comprising an 
outline of the semester’s work, selections from 
philosophers, a glossary of terms, anda read- 
ing list. In the Philosophy 1B class, the exam- 
inations covered both textual materials and some 
additional material presented in class. This ad- 
ditional material consisted almost entirely of 
elaboration of the textual material, rather than 
radically new matters. In the discussion section, 
this was accomplished for the most part through 
student discussion; occasionally, the instructor 
supplied information when it seemed to be re - 
quired by the discussion and the students did not 
seem able to supply it themselves. 

Since, presumably, students in both lecture 
and discussion groups had equal access to the 
textual material, differential performance onthe 
tests presumably reflects differential effective- 
ness of the two methods of teaching. 

The examinations were prepared in the fall 
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in advance so that the instructor might not be 
biased more for the spring students by his 
knowledge of the test-content than for the fall 
students. 

Item analyses of each examination after its 
first administration were made and items prov- 
ing inconsistent with the final testas a whole 
were not included for scoring purposes. The 
final examinations for the most part consisted 
of items from the mid-terms which had shown 
themselves (in the fall) to be most discriminat- 
ing. The students were informed that this would 
be the case and had opportunity to review the 
mid-terms. 

The examinations sought to test for signifi- 
cant factual knowledge as well (as far as possi- 
ble) as for understanding and reasoning ability. 

The semester grade was determined not only 
by the scores on the examinations, but also by 
papers that students prepared. Points earned 
on the papers were added to the scores on the 
tests to constitute the ‘‘performance’’ score. 


Bell Adjustment Inventory 





This inventory, developed by Hugh M. Bell 
of Chico State College, consists of 160 items 
designed to measure home, health, social, and 
emotional adjustment. High coefficients of val- 
idity (. 72 to . 90) and of reliability (. 93) inschool 
situations are reported by Bell for the inven- 
tory (2). Although the validity of personality in- 
ventories in general as measures of emotional 
adjustment has been questioned in recent years, 
consideration of the exigencies of the classroom 
situation led to the selection of the Bell as the 
most adaptable and appropriate to the purpose 
at hand. The inventory was administeredat the 
beginning and end of the semester to each class 
involved in the present study. 


Instructor-Rating Form 





Using the Likert technique (5), the writer 
developed a 90-item instructor-rating form (13) 
designed to tap, especially, the students’ emo- 
tional attitudes toward the instructor. Although 
the ‘‘best’’ instructor, in terms of significant 
long-run changes in his students, is not neces- 
sarily the most popular, yet it was thought de- 
sirable to measure students’ emotional attitudes 
towards their instructor as possibly diagnostic 
of their attitude towards the subject-matter 
and towards the educational enterprise in gen- 
eral. 

A coefficient of reliability for the scale, 
computed by the split-half method and correct- 
ed by the Spearman-Brown formula was found 
to be .969. A coefficient of validity was se- 
cured as follows: 

Students in two classes in Educational Psy- 
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chclogy (N about 75) were asked to rate two in- 
structors of their own choosing, one of whom 
they admired, the other whom they disliked. 
Numbered answer sheets were distributed and 
the students instructed to use the even-number- 
ed answer sheets for rating the admired instruc- 
tor, the odd-numbered answer sheets for rating 
the disliked instructor. Neither the name of the 
rater nor of the ratee was to appear on the ans- 
wer sheets. The median test (7,8) for signifi- 
cance of the difference between the two distribu- 
tions gave the highly significant <* of 96.9 (P 4 
-001). Biserial r between scores and expressed 
attitude was found to be .903. Samples of items 
in the form follow: 

He is likeable. 

He is sincere. 

He is at a mental plateau. 

He is devoid of personality. 


The students in each of the six classes in- 
volved in the present project had an opportunity 
at the end of the semester to rate the instruc- 
tor using this instructor-rating form. They 
were instructed to refrain from affixing their 
names to their rating forms. 


Free Comments 





After the final examination, each student was 
invited to write anonymously on paper provided 
‘‘any comments you may wish to make on the 
course, the text, the method of instruction, the 
examinations, the instructor, or on any other 
matter you care to discuss. ’’ A number did so, 
and their comments throw some light on the dyn- 
amics of the experiment, as we shall see later. 


Names Known 





Using a method described by Pressey and 
Hanna (10), the writer asked each student at the 
end of the semester to list the names of all his 
fellow classmates whose names he knew. He was 
asked also to designate those with whom during 
the semester he had associated outside of class 
approximately 20 hours or more (disregarding 
association in other classes). In effect, the writ- 
er was seeking to determine whether one class- 
room procedure was more likely than the other 
to facilitate students’ becoming acquainted with 
one another, as indicated by knowledge of one 
anothers’ names and by their seeking out occas- 
ions for association outside of class. 


Other Data 


Additional data were secured (as far as pos- 
sible) regarding each student’s age, score on 
the American Council on Education Psycholog- 
ical Examination, and college status (as meas- 
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ured by number of college units earned), These 
data were obtained from the college registrar; 
it was unnecessary to ask the students for them. 
Sex of each student was also recorded. 
SECTION III 
RESULTS 


Performance Outcomes 





Analyses of covariance were performed to 
ascertain the significance of the differences in 
performance scores when aptitude as measured 
by the ACE was held constant. The procedure 
followed was that described by Johnson (4), with 
some additions from McNemar (6). Only in the 
Psychology 1 sections did a significant differ- 
ence in performance appear when ACE scores 
were kept constant. The uncorrected difference 
in favor of the lecture section was 24 points. 
This difference is significant at better than the 
one percent level of confidence. The coeffic- 
ient of correlation (Pearson r) between the ACE 
scores of these Psychology 1 students and their 
performance scores is .485. This coefficient 
represents a variance of .232. Hence, 23.2 
percent of the variance in the performance 
scores is accountable for in terms of the ACE 
scores. When ACE was held constant, there 
was a difference in performance of 19.9 points. 
This difference too is significant at better than 
the one percent level of confidence. (The F ra- 
tio of the ‘‘within’’ to the ‘‘between’’ variance 
is 9.49.) 

In both philosophy courses, the differences, 
though not significant, favored the discussion 
sections. The lecture sections in both cases 
had greater scholastic aptitude (as measured by 
the ACE), but even when this disadvantage was 
compensated for by the analysis-of-covariance 
technique, the differences in performance in 
favor of the discussion sections still failed to 
reach statistical significance.’ 


Bell Adjustment Inventory Changes 





Judging from the norms Bell provides for in- 
terpreting scores on his Inventory (2), a given 
score has a somewhat different significance for 
men than for women. ‘‘Average’’ scores for 
men run between 23 and 41, but for women 
they run between 25 and 47. A%* test of sig- 
nificance was therefore applied to the sex dis- 
tributions in all six classes. The formulas 
are taken from McNemar (6). In none of the 
philosophy classes did P reach .10. In the Psy- 
chology classes, however, with a preponder- 
ance of women in the discussion section and 
men in the lecture section, P was less than .02, 
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Bell score changes then were computed for the 
men and for the women separately in the psy- 
chology classes. 

Table I reports all Bell score changes and 
their significance. The formulas are taken 
from McNemar (6). As the table shows, the 
Philosophy 1A students in both sections made 
highly significant gains (toward better adjust- 
ment). Both men and women in the Psychology 
1 lecture section made gains significant at the 
5 percent level. The men in the Psychology 1 
discussion section made gains significant at the 
10 percent level. None of the other changes 
reached this level of significance. 

When we contrast the changes in the lecture 
sections with the changes in the corresponding 
discussion sections, we find that not one of the 
differences in changes reaches the 10 percent 
level of significance. In all cases, the lecture 
sections showed greater gains (toward better 
adjustment) than the discussion sections. Al- 
though none of these differences is individually 
significant, the congruence of results all favor- 
ing the lecture sections bears consideration. By 
chance, one could expect such a four-fold con- 
gruence only once in 24 times; that is, the prob- 
ability of such an occurrence is .06. This ap- 
proaches significance. 

Pooling the gains for the philosophy lecture 
sections and comparing them with the pooled 
gains of the philosophy discussion sections also 
gives a slight advantage to the lecture sections, 
but this too is not statistically significant. 


Instructor-Rating Form Results 





Table II exhibits chi squares and P’s for the 
differences between the corresponding distri u- 
tions of response to the Instructor-Rating Form 
as computed by tae median test (6,7,8). As the 
table shows, both philosophy discussion sections 
responded significantly more favorably to the 
instructor than the corresponding lecture sec- 
tions. No significant difference appeared inthe 
responses of the two psychology sections. Such 
difference, however, as exists’ favors the lec- 
ture section. 

Some specific items were selected for evalu- 
ation when on inspection differences in re- 
sponse seemed large enough to favor a likeli- 
hood of significance. The median test was used 
again in some cases; in others, the more usual 

technique was applied. 

Two items thus selected favor the lecture sec- 
tion of Psychology 1 at the 10 percent level of 
significance or better. Two items favor the dis- 
cussion section of Philosophy 1A at the two per- 
cent level of significance or better, and to fav- 
or the discussion section of Philosophy 1B at 
the 5 percent level of significance or better. 

Those favoring the discussion sections are: 





13. He is willing to accept new ideas. 

37. He gives students the feeling that they 
are part of the ‘‘teaching process, ’’ not 
mere receivers of the teaching. 

47. He provokes lively discussions. 

58. He fidgets while talking. 


Those favoring the psychology lecture sec- 
tion are: 


55. He apparently puts many hours of prep- 
aration into his classes. 
75. His lectures are logical. 


Free Comments 





The writer examined the free student com- 
ments (secured at the end of the semester for 
each class in the manner described above) and 
labeled each as favorable, predominantly favor- 
able, unfavorable, and predominantly unfavor- 
able. Since the numbers were rather small, the 
favorable and predominantly favorable categor- 
ies were combined, as were also the unfavor- 
able and predominantly unfavorable categories. 
A sizeable proportion of students (40 percent in 
all) did not take advantage of this opportunity to 
comment. With regard to those who responded, 
the results show that the lecture sections are at 
no disadvantage as far as the distribution offree 
favorable comments is concerned. Two of the 
differences favor the lecture sections (Philoso- 
phy 1B and Psychology 1) and one the discussion 
section, but in no case does the difference be- 
tween lecture and discussion reach a five per- 
cent level of significance. In the Psychology 1 
classes, the difference favoring the lecture sec- 
tion is significant at the 10 percent level of con- 
fidence. 

The content of the comments may be signifi- 
cant for a better understanding of the dynamics 
of the two learning Situations. Consideration 
of the content of the comments suggests these 
trends: 

Variations in response among students seem 
somewhat greater for the lecture sections than 
for the discussion sections. Thus one student 
in Philosophy 1A lecture wrote ‘‘I found this a 
very stimulating and worthwhile class.’’ An- 
other wrote: ‘‘The lectures were complete and 
well-presented.’’ In contrast, a third in the 
same class wrote ‘‘The lectures seemed totend 
toward monotony at times.’’ Similarly, in the 
Psychology 1 lecture, one student wrote ‘‘In- 
structor makes lectures too good to miss, ”’ 
while another wrote ‘‘The lectures were rather 
boring and added little to my understanding of 
the subject matter. ’’ 

Those who responded favorably to the lecture 
situation, expressed their appreciation interms 
of what they learned. In the discussion situa- 
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tion, the emphasis seemed to fall more on the 
stimulation the student had received rather than 
on the information he had acquired. In the Phil- 
osophy 1A discussion, a student wrote ‘‘I walked 
out of this class feeling as though I had used 
what intellect I may have.’’ Similarly, in the 
Psychology 1 discussion, a student commented, 
‘*I thoroughly approve of the method of instruc- 
tion, as it stimulates the students to think more 
about the subject. ’’ Conversely, dissatisfaction 
in the discussion sections was expressed in 
terms of the instructor’s failure to transmit in- 
formation. Wrote a student in the Philosophy 
1A discussion, ‘‘You did not tell us enough. ’’ 
Another, ‘‘At times it was frustrating just to 
figure out exactly what you did feel or believe.’’ 
A third, ‘‘You never voice an opinion.’’ Yet 
ironically, when, in the lecture sections, the 
instructor did express his views, he was criti- 
cised for doing so. In the Philosophy 1A lecture, 
a student wrote, ‘‘The instructor is too biased 
in his opinions. He definitely teaches his own 
philosophy unerringly. ’’ 

Devaluations of oneself and of one’s fellow- 
students were frequently expressed in the dis- 
cussion sections. ‘‘We are just beginners ina 
field which you have gained great knowledge in.’’ 
‘*I don’t enjoy listening to other students—whose 
opinions are as crackpot as mine-—spout off what 
they think.’’ ‘‘The students are not ready for 
discussion and some of the discussions get stu- 
pid.’’ Parallel with this was the frequent ex - 
pression of need for assurance. ‘‘I couldn’t al- 
ways be sure that the other students in the class 
were right and I wanted an authoritative view. I 
consider you an authority on the subject. ’’ ‘‘The 
questions were left hanging without a definite 
conclusion. It is a good idea to let the students 
discuss but after they are through the instructor 
should sum it up and draw conclusions so there 
is a definite answer left in your mind.’’ Some 
felt that they were not receiving sufficient help 
in preparing for the examinations which, in con- 
trast with the text which seemed ‘‘vague and un- 
decided, ’’ required ‘‘pinpoint’’ knowledge. 

There seemed more evidence in the discus- 
sion sections of the student’s willingness to take 
responsibility for his shortcomings. ‘‘Had Iput 
more into the course, I could have gotten more 
out of it.’’ ‘‘I’'ve enjoyed your class very much. 
I didn’t learn everything I should have, but that 
was my fault, not yours.’’ In the lecture sec - 
tions, a variety of complaints were made: ‘‘Not 
enough work is required.’’ ‘‘Your method of 
grading is wholly corrupt.’’ ‘‘More explanatory 
material [in the syllabus]}.’’ ‘‘I personally pre- 
fer essay examinations. ’’ ‘‘ { The instructor] 
should follow the test [sic } book like the other 
teachers do.’' ‘‘The purpose and meaning of ex- 
periments [ should | be given a fuller treatment 
in class discussion. '’ ‘‘The exams are too 





(Vol. XXII 


specific. ’’ 


Names Known 





The writer tabulated the number of names of 
fellow-students known at the end of the semes- 
ter by each student. Table III presents com - 
parisons of the number of names known by stu- 
dents in lecture classes compared with the num- 
ber in discussion classes. The table also pre- 
sents data regarding the names of those with 
whom the student had associated outside of class 
approximately 20 hours or more. Names of 
those known previous to entering class were ex- 
cluded. The students also were to disregard 
time spent in other classes with a student when 
judging whether 20 hours or more had been 
spent in his company. 

As the table shows, in every case, students 
in the discussion sections knew more names 
than those in the corresponding lecture sections, 
at a level of significance better than .001. For- 
mulas used to compute C. R. andt are from 
McNemar (6). In addition, the students in the 
Philosophy 1A discussion section had cultivated 
intensive acquaintance with their fellow-students 
in significantly (P Z .001) greater numbers than 
had those in the lecture sections. (P was not 
significant in the other courses. ) 

It should be added here that students in the 
lecture sections had the following opportunities 
to learn the names of their fellow students: 


a. Toward the end of the semester, each stu- 
dent (present at the time) was informed of his 
standing to date. On the hectographed sheet re- 
cording his grade were contained also the names 
of all the other students in the class. 

b. The instructor followed the practice of 
calling each student by name when recognizing 
him to speak. 

c. Students were seated alphabetically at the 
beginning of the semester; the instructor called 
their names aloud when he seated them. 


There is no question, however, that students 
in the discussion sections heard the names of 
their fellow-members more frequently than did 
members of the lecture sections. In addition, 
in the course of the discussions, students would 
frequently address their remarks to some par- 
ticular student and call him by name. 


Other Data 


Analysis was made of the distributions of 
age and college status for the contrasting sec- 
tions of each course. The median test was 
again used for assessing significance of differ- 
ences. 

None of the differences reached a 5 percent 
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or better level of significance except those for 
Psychology 1. Here tne discussion students 
were significantly (P . .001) younger and had 
had less college work than the corresponding 
lecture students. Indeed, 87 percent of the Psy- 
chology 1 students had had no college work pre- 
viously whatsoever, in comparison with 30 per- 
cent in the Psychology 1 lecture section who had 
had no previous college work. Ninety-three per- 
cent of the Psychology 1 discussion students 
were under 20 years of age, compared with 49 
percent of the psychology lecture students in 
that age group. In none of the other courses 
were the age and college-status differences so 
marked. 


SECTION IV 
DISC USSION 


This study leaves unanswered a great many 
questions. Some of these contain implications 
for further research. 


1. Is difference insubject-matter important 
for method? Would results for chemistry, e.g., 
differ from those for history? In the field 
of psychology, would results differ fora 
course in mental hygiene as compared with one 
in experimental methods or in statistics? What 
factors are significant here? The degree of ref- 
erence to personal problems? The presence of 
a body of authoritative facts? The degree of 
emphasis upon acquiring skills as opposed to 
acquiring information? The level of the course 
(whether elementary or advanced)? Are atti- 
tudes and skills affected more by the discussion 
procedure than is subject-matter mastery? 

2. Are differences in instructors important? 
Does skill in lecturing make a difference? Does 
the degree to which an instructor is capable of 
self-abnegation make a difference? Does the 
ability to achieve insight into others’ problems 
make a difference? Do flexibility and degree of 
open-mindedness make a difference? Do com- 
petence in one’s field and conscientioysness in 
preparing one’s lectures make a difference ? 

3. Are differences in students important? 
Age? Sex? Degree of emotional and social ma- 
turity? It may be of relevance here that in the 
Psychology discussion section, the men made a 
larger gain in emotional adjustment than did the 
women, while in the lecture section it was the 
reverse. It might have been desirable to incor- 
porate the age, college status, and sex variables 
into the analysis of covariance, or to make ap- 
propriate corrections in some other manner, so 
that these factors too may have been kept con- 
stant for performance comparisons. 

4. Are differences in social climate import- 
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ant? Does a fluid individualistic society make 
different educational demands from those which 
a stable, conformity-exacting society makes? 

5. What are the long-run effects of the two 
methods? Which leads to continued study? 
Which promotes the capacity to deal with new 
problems more? Which is more likely to moti- 
vate the student toward thorough mastery as con- 
trasted with superficial acquaintance and glib 
parrotting? Which cultivates more the habits 
of independent critical and creative thinking ? 
Compelling the student to rely upon his own 
powers may make him feel insecure if he is un- 
accustomed to this shouldering of responsibility 
or unable to handle this responsibility. But if 
this experience is a prelude to growth, thenper- 
haps it is to be welcomed rather than censured. 

6. What outcomes ensue when the two meth- 
ods are combined? Does deyree of nondirect- 
iveness in discussion make a difference ? 


These are broad questions and would need to 
be translated into specific research issues be- 
fore progress could be made toward their solu- 
tion. They indicate, however, the complexity 
of the problem. Much work, itis perhaps 
needless to say, remains to be done inthisarea 
in order to identify the most effective proced- 
ures in college teaching. 


SECTION V 
SUMMARY 


The present study has sought to measure sig- 
nificant outcomes of two major teaching proced- 
ures in college teaching. Specifically, it sought 
to determine whether there are significant dif- 
ferences (a) in mastery of susject-matter as 
measured by course examinations and assigned 
papers, (b) in emotional adjustment as meas- 
ured by the Bell Adjustment Inventory, (c) in 
attitude towards the instructor as measured by 
the Ruja Instructor-Rating Form and as indicat- 
ed by free student-comments at the end of the 
semester, and (d) in social adjustment as meas- 
ured by extent of knowledge of names of fellow- 
members and extent of acquaintanceship with 
fellow-members for periods of 20 hours or more 
during the course of the semester. 


Hypotheses 


Four hypotheses were set up for evaluation. 
We may consider each hypothesis now in turn. 


a. The first hypothesis is not supported. The 
students in the discussion sections did not sur- 
pass those in the lecture sections in subject- 
matter mastery. Although the philosophy stud- 
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ents in the discussion sections did equally well 
with those in the lecture sections, the psychol- 
ogy discussion students performed at a signifi- 
cantly lower level than the psychology students. 

b. The second hypothesis is not supported. 
Use of the Bell Adjustment Inventory showed no 
significant differences in adjustment gains for 
discussion as compared with lecture. Rather, 
for each of the comparisons made (Philosophy 
1A and 1B, Psychology 1 men and Psychology 1 
women), the lecture sections made greater gains 
than the corresponding discussion sections; hence 
there is some strength to the contrary hypothesis 
that the lecture method promotes emotional ad- 
justment, as measured by responses to the Bell 
Inventory. 

c. The third hypothesis is supported in part. 
The instructor was rated more favorably by the 
philosophy discussion sections than by the cor- 
responding lecture sections. However, no sig- 
nificant difference appeared for the psychology 
classes. 


The discussion sections felt that the instruc- 
tor was willing to accept new ideas, that he gave 
students the feeling that they were part of the 
‘‘teaching process’’ and not mere receivers of 
the teaching, and that he provoked lively dis- 
cussions; moreover, they were less conscious 
of nervous mannerisms which the instructor ex- 
hibits as he speaks. Those who favored the lec- 
ture procedure were impressed by the amount 
of time the instructor apparently put in in prep- 
aration for his classes and by the logical and 
systematic quality of his lectures. 


The students in the lecture sections stressed 
the classroom situation as providing opportun- 
ities for learning new ideas.. The students in 
the discussion sections seemed more likely to 
blame themselves for failure than the instruc- 
tor, the examinations, or the textbook. On the 
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other hand, they missed the sure direction and 
definite assurances which an instructor-center- 
ed class can provide. 

d. The fourth hypothesis is supported. As is 
perhaps to be expected, students in the discus- 
sion sections got to know one another in greater 
numbers than in the lecture sections. This is, 
perhaps, however, only a superficial acquaint- 
ance as measured by knowledge of one another's 
names. Only for the Philosophy 1A students was 
the difference between the number of those inthe 
discussion section who spent 20 hours or more 
in one anothers’ company and the number of those 
in the lecture section who did the same signifi- 
cantly different. Perhaps a one-semester class 
which meets but two or three times per week 
cannot be expected to do more in this regard 
than to acquaint students with one another. This 
there is no doubt, the discussion room can do 
much better than the lecture hall. 

In short, lecture proved superior in subject- 
matter mastery for the Psychology 1 students. 
Discussion proved superior in names known, 
for all classes; in attitude toward instructor, 
for the philosophy classes; and inintensive 
acquaintance, for the Philosophy 1A class. In 
all other regards the two methods showed no 
significant differences. (See Table IV) 

To express the results in terms of the course: 
the philosophy discussion students learned more 
classmates’ names and rated the instructor high- 
er than did the philosophy lecture students. The 
Philosophy 1A discussion students, in addition, 
established a greater number of intensive ac - 
quaintanceships than the 1A lecture students. 

In all other regards, the results were equal 
for the lecture and discussion groups. The Psy- 
chology 1 lecture students learned more of the 
content of the course but knew fewer classmates’ 
names; in all other regards the results were 
equal, 


REFERENCES 


. Asch, M. J. ‘‘Nondirective Teaching Psy- 
chology: An Experimental Study, ’’ Psycho- 
logical Monographs, LXV (1951). 

. Bell, H. M. Manual for the Adjustment In- 
ventory (Stanford, Calif.: Stanford Univer- 
sity Press). 

. Faw, V. ‘‘A Psychotherapeutic M et hod of 
Teaching Psychology, ’’ American Psychol- 
ogist, IV (April 1949), pp. 104-109. 

. Johnson, P. O. Statistical Methods in Re- 
search (New York: Prentice-Hall, 1949). 

. Likert, R. ‘‘A Technique for the Measure- 
ment of Attitudes, ’’ Archives of Psychol- 
ogy, XXII (1932). 




















6. McNemar Q. Psychological Statistics (New 
York: John Wiley and Sons, 1949). 

7. Mood, A. M. Introduction to the Theory of 
Statistics ( New York: McGraw-Hill Book 
Co., 1950). 

8. Moses, L. E. ‘‘Non-Parametric Statistics 
for Psychological Research, ’’ Psychologi- 
cal Bulletin, XLIX (March 1952), pp. 122- 
143. 

9. Murphy, G., and Spohn, H. An Introduction 
to Psychology (New York: Harper and Bro- 
thers, 1951). 

10. Pressey, S. L., and Hanna, D. C. ‘‘The 
Class as a Psycho-Sociological Unit,’’ 














JOURNAL OF EXPERIMENTAL EDUCATION (Vol. XXII 


Journal of Psychology, XVI (January 1943), cations, and Theory (Boston: Houghton- 
pp. 13-19. Mifflin, 1951). 
. Rogers, C. R. Counseling and Psychother- 13. Ruja, H. ‘‘A Student-Centered Instructor- 
apy (Boston: Houghton Mifflin Co., 1942). Rating Scale, ’’ Educational Administra- 
. Rogers, C. R., and others, Client-Center- tion and Supervision, XXXIX (April 1953), 
ed Therapy: Its Current Practice, Impli- pp. 209-217. 




















ERRATUM 


Mr. William H. Lucow wishes to correct a smaller- 
ror that appeared in his article, ‘‘Estimating Compon- 
ents of Variation in an Experimental Study of Learn- 
ing, ’’ published in the March 1954 Journal of Experi- 
mental Education, page 270, first column, second ex- 
pression. This expression should read: 
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